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ABSTRACT 

This publication presents the latest fipdings about 
the effects of Title' I' programs in the Cleveland, t)hio,. schools. 
These evaluation reports cover the 19 79^80>prograa period, and 
present information about the effectiveness of each program in 
attaining the objectives proposed for each 4 com^onent. The programs . 
include: Child Development Project; Children ^in Institutions Project: 
Cleveland fundamental School Basic Skills Reinforce aen-t Project; f 
Diagnostic' Reading Clinic: English-As-A-Second Language Project;' \ 
Mathematics* Skills Improvement Project; Project Reach; Ptoject STAR; 
Pupil Adjustment Project; Reading Improvement Project; Reading 
Strategy Pi^ject; an4 Resident Tutor Project. (Author/GK) ^ 
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FOREWORD ' • 

• ^ ix 

Evaluation is an integral part .of the process by w;hich 
schools can improve their educational programs. Through the 
information generated by evaluative activities, founder decisions 

can be made about the effects of instruction on pupil learning. 

«, */ •» 

The Cleveland Public Schools are proud of the Department 

of Research, Development 'and "Evaluation for the excellent /evalua- 

tive services provided for Title I programs.' 4Jf 

This publication, Title I Evaluation Reports--1979-80 

presents the latest findings about. the effects of Title I ^programs 



in the Cleveland schools. 
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'introduction 

Since the spring of 1966, the Cleveland Public Schools 

i • 
have implemented program components under Title I of the Elementary 

* * 
and Secondary fthication Act. These components have been directed* 

at improvement of educational opportunities for disadvantaged yc^th 

attending Cleveland schools. f ' 

» Members of the Department of" Research, 4 Development and 

I Evaluation have had the resjion^ibility for designing and implement- 

ing the evaluation of these program components. This publication 

o 

contains their evaluation reports for the 1979-80 program period. 

i 

These reports present information about the effectiveness of each 

* * ■ * 
program in attaining the objectives proposed ^for each component* . 
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'1979-1980 



CHILD DEVELOPMENT 



t 



PURPOSE, AND OVERVIEW 



1979-80 Tit I 

1 



#4 



I Evaluation 



The major goal of the Child Development Project is to provide £qt 
eligible children basic 'experiences r which are.not generally available^in 
the home and which promote learning skills essential, to success .in future* 
schooling. (Eligibility is 'established by a scorq below the 33rd -percen- 
tile on Tests "of Basic Experiences, 'Genera^, Concepts, Level ^.) Four-year^ 
olds*, in classes of approximately 20, are- scheduled into half-day, five- 
days-a-week sessions at centers in public schools^ E^ch center^ is staffed 
with, a teacher and an educational aide.. Pre?- reading skills^and parent edu- 
'cation/mvolvem^frt are emphasized. Differentiated inservice for staff re- 
presents an'other phase of oftgoing project op,eratioris . — — 

This evaluation has been based »on approximately six fewer weeks % 
of project se^ice to children thafn in previous years. .A strike beginning 
on October 18 , 1579 resulted in the closing of schools on November 7 . They 
reopened on January 4, 1980. The children were in school for the full*- 
quota of days .(until July 23, 1980) , but summative data collection' was 
completed late^May, as usual. * > 



SERVICE sommar: 

Number of- Pupils Served : 1/671 
* * 

Ntimber of Schools :-. 44 (public) 
• (See lis.t included as Appendix A.) 

Staffing; ■ 1 Project Manager tFT), 

5 Coordinators (P£ - 40%) : 

• Curriculum, Supportive 
Services, Special Ser- 
vices, Medical, DefttaK 

, 5 Consultant Teachers , 
(3 FT; 2 PT - 40%: 
Reading, Special Set- 

• vices) 1 



Grade Served:* Pre-fc 



Yearg in deration : 1*5 . 5 



s ,(40 FT; 3 PT - 



£5 TeacHJ 

50%) ' , 
5 Social -Workers (4 FT; 

-1 PT - 40%) 
2 Speech Therapists 
4*~&lucational Aides 

• L^>PT - 50%) 
.3 Clerks (FT) 
2 Custodians (FT) 



(FT) 
(41 FT j 



Total Title I Expenditures : . $l',638>562j ^ Per Pupil Cost : $981 



OBJECflVES AND OUTCOMES 



J 



Process Objective 1 : Differentiated inservice meetings will be 
scheduled for instructional ana supportive services personnel- , ^. 

>. • _ 

. Outcome: Available information clearly indicated that this ob- 
jective was attained. Document at ion from a variety* of sources 
pertained to.* this objective, Inservice agendas and hand-outs, 
as well as directives to project staff, were filed with the eval^ 
uator throughout the year. * Copies of the project manager's su ^ 
• mary reports to the" Directing 'Supervisor, Compensatory Education 
(March 1 and June, 19,80) were made- available. In early Jufie, 1980 
responses to a classroom-staff survey were submitted fey 32 (74.4%) 
of tha projectrt.eachejrs- and 25 (56.8%) of the aides. (Hesults^are 
included 'as Aj^pen^ices^fr and C, respectively.) 

From these sources, it was clear that project inservice during 
1979-1980 had been highly differentiated. The total project 
staff was involvedHsimultaneously) in some worksliops, such as 
orientation/organization on 'September 6, 1979 and ."affirmative 
educatiofi" on May 5, 1980. All project teachers were convened 
- on January 18 and April 14-15? 19,80 to learn procedures' for in- • 
corporating Child Development children* into the system's Auto- 
" mated Pupil Records* and Title I Census. All teachers and aides 
ijew to the project were scheduled into' sessions on September* 7, k 
1*979 and January 30, 1980 for supplementary inservice instruction. 

In the manager's reports (March 1 and .June 1, 1980) covering ap- - 
proximately six-and-a-half months of the school year* 84 staff- 
development activities were noted. This represented^ an average 
• *o£ approximately 13 inservice events per month'.. Besides sessions 
for full project staff and various subgroups, tfce list included 
local/state, university/community events pf special .interest to 
early childhood educators as^ell as a multiplicity of systeih- 
wide sessions on topics, silch as: desegregation, (compensatory 
education) project management, health services, Lau/bi lingual 
programs^-at which Child Development was represented by one or 
more staff members,. * ' ' , ^ v 

* - * 

Under the manager's supervision, the Coordinator %>f Consultant 

Teachers) for Curriculum Development and Inservice Training As- 
sumed the responsibility for designing and implementing a variety * 
of staff development activities for classroom teachers and teacher 
assistants, with emphasis on assessment and language "development . 
v For project classroom staff, the most frequently Tjoted topic in » 
the manager's reports was "assessment 11 -- of childrelfPI needs and 
progress, ^especially in language development and related areas. 
A large majority of teachers (approximately. 62 .5%) responding to 
the staff syrvey indicated that "observing behavior," "analyzing 
Assessment data," and "prescribing instruction" had been emphasized 
in 1979-1980 inservice "often" or ^"every time." Among' the aides, 
70.0% corroborated this level of emphasis on "observing behaviof" 




•and 60.0% on- "prescribing instruction. 11 Smaller majorities of 
teachers 53.1% reported com^rable emphasis on "recording obser- 
vations" and "implementing prescriptions." (See Appendices B, C.) 

Most (81.3%) of the teacher respondents indicated that "under- 
standing language development" hadt been emphasized "oftfcn" or 
"every time"' and 78~.2% that "facilitating language -growth" had 
' been featured equally frequently. Sixty-four per cent of the 
aides concurred. These survey responses reflected appropriately 
differentiated ^emphasis for teachers and aides^o^ "analyzing 
assessment Mata,"< "understanding language development" and 
"facilitating language growth." 

•Classroom staff were asked to rate the overall helpfulness of this 
year's projectwide inservice. Of teacher-respondents, 31.1% marked 
"excellent," as did 40.0% of" the~ai4^s . More pertinent to this 
first process objective, s'taff w£re asked to indicate the extent 
to which "this year ? s . inservice--individual (on-site^ and small - 
group, as we}l as proj#ct--provided for your own special and ' 
individual needs." 1 All but two teachers and one aide (of the 52 
staff .answering that item) marked from "some" through "greatly," 
with 34.4% of the teachers and 44.0% of the aides selecting the 
latter. (The slightly larger percentages indicating the most > „, 
favorable response to the total--as contrasted with only the 
projectwide--inservice suggested the value of individualized on- s 
site inservice referred to in the second process objective.) < 



Process Objective 2 ; Utilization of effective teaching techniques 
will be encouraged through use of a Classroom" Observation Checklist 
with each teacher at leas^ once during the year. 

.. Outcome : Teacfifcrs 1 responses on the staff survey (presented as 
Appendix B) indicated that this objective was virtually attained., 



Approximately three-fourths of the teachers and aides reported in 
Item 5-a that they had been visited four orAfcre times during 
1979-1980; almost one-third reported seven o^|ore visits. Of 30 
teachers responding to Item 5-b on the classrbom staff survey, 29 
(96.7%) reported that the Checklist had been-used on at least one 
occasion when a consultant teacher or other projecj-central-staff 
^person visited the classroom to observe project operations. Nine^ 

^ teeri (82.6%) of 23 aides responding to thi£ item, indicated that 
th^ehecklist had been utilized at least'once during 1979-1980. 

a All responding teachers and most (81.0%) aides indicated that a 
post-obiervation conf erence/di'sscussibn was held on at least one 
of these (observation) occasions. 



Process Objective _3; Health maintenance and social competency of 
families of participants will be encouraged through cooperative ef- 
forts of project staff, school staff and community resources. • 



* v • y - * % ' 

Outcome : Project "staffing and documents, as^well as staff-survey 
, responses, indicate^ that this objective was attained. 

Project commitment to families, to .parents ^Ts partners in chil- 
dren's education, continued to be evident—first, in the staffing 

\ pattern. In addition .to t-h'e teachers and aides, curriculum coor- 
dinator, consultant teachers, reading consultant arid speech thera- 
pists,, the proj%ct manager's staff included professional personnel 
in "several areas directly -related to the "health maintenance and c 
social competency of families of participates ." The coordinator 
of supportive services With five (4.5 FTE) 'social workers; the § . 
coordinator for special (parent/volunteer) services and^the special- 
services consultant teacher; the coordinator for medical (RN) and 
dental^ (RDH) services — all £ohtributed to attainment of this ob- 

» jective. 

* * * 
Also, ^extensive reports filed by supportive staff and special-ser- 
vices personnel — and classroom-staff survey responses — cfocumente^i ^ 
"cooperative efforts of project stjtfff, jchool, staff and community 

'- resources" in relation to participants' apd their £arftilies' health 
naintenance and social competencies. 

. Project efforts along these, lines—as in previous years--began 
with the intake process, at which time reports of the child's 

< recent^ physical Examination and immunization were required, and - 
the parent (s) provided the interviewer (teacher or member of 
project central staff) wij;h information about the child r s 
medical and social history. 

* ■ . ; 

. Tlixoughout the year, project staff screened 1,302 children for 
speech, 1,391 for hearing and 762 for Rental problems—and made 
referrals, as necessary, to specialized school personnel and/or 
community resources. Social 1 workers observed children in class-- 
room settings, better to assess pupils 1 needs and to make re<- 
coijjHfendations . 

. Contacts among project supportive services personnel, princi- 
pals, teachers and "regular 1 ' (i.e., non-project) supportive staff 
were frequent. Project social workers averaged 14 school-staff 
cohtacts per week, the health coordinator (RN) 20.5 and speech 
therapists 3.6 (over about 23.5 weeks of the&school year). 

JL 

. Project teachers '/assistants 1 survey responses (included as 
Appendices B and C, respectively) revealed, for example, that 
almost all classroom-staff respondents had consulted a project 
spdial wdrker or speech therapist, the principal, another Early 
Cliildhopd teacher or assistant, and/or the "regular" school , 
nurse, abou<t at least one* pupil --the majority, about "several" 
4)^ "all" the chi-ldren. * 

Classrdom and central staff maintained contact with parents. 
All teacher respondents indicated that they had conferred at 



/ 



least once (other than intake inter^tiew) § with a family repre- 
sentative of !t several ft to "all" pupils. 'A total* of -2,506. 
individual conferences was reported by the manager. More than 
600 telephone conferences and 190 home visits, also, were logged 
by classroom and supportive service staff. 

Parents were encouraged to come to sdhool for meetings, obser- 
* vat ion of instruction and volunteering in classrooms. The man- 
ager reported 1 that 536 parents had spent some 2,651 hours in 
parent meetings. All classroom-staff survey respondents in- - 
dicated that parent (s) of at least onej>£ytwo children (most 
"several* 1 or "about half 11 ) had attended at least one school- 
wide, or Early Childhood meeting for parents. The manager re- 
v ported 847 parent visits to' classrooms,' and most classroom 
personnel (approximately 72% of the teachers and^60% of the 
aides) indicated that parents of "about half" or more pupils 
* had come to observe. The coordinator for special services 
compiled 9,760 hours of classroom-volunteer time by 592 Child 
Development parents. 

* , • V * 

Also, staff promoted parent -involvement and growth in and through 
citywide events such as the following. On February 20 Early 
Childhpod parents representing, 51 schools (including 50 Child 
Development parents) met with the 'Directing* Supervisor , Compen- 
satory Education Programs, for information ami planning. About 
40 project parents were among the 125 participating in Augusta 
Baker's presentation, "Once Upon a Time," .sponsored by special- 
services, and fjfinded by the Cleveland Public Library. 

Production and distribution of three issues of "The Bridge" (Febr 
. ruary,-May and July, 1980) represented a third kind of effort for 
attainment^of t*he third process, objective. THis newsletter, edited 
by^fche special-Services cbordinator, informed parents of supportive 
services in school, projects and community and recognized their 
active involvemfent with children's education. 

4 

Product Objective 1 : Project part¥etpan£§ 1 nfe'an post -test" scores 

on Tests of Basic Experiences will be at? least seven NCE uriits higher 

than the mean pre-test TOBE scores. 

$fc Outcome: This objective was attained in Language but not in Mathe- 
matics . 

In October, 1979 TOBE; Language/Mathematics (Level K) were admini- 
istered to a project -wide sample of children- in Child Development. 
In May, 1980 most of these same children again completed both 
tests.* (See Appendix D for pre-post results.) -V 

■ The mean NCE score on Language moved from 40.2 in October to 49.4 
in May, yielding a mean gain of 9.2 NCE units fdr the project sample 
p (N=205) . Although this gain exceeded 'the proposed' seven units, it 
> was less t^an the 14-to-17-point gains, of the three previous years. 



In Mathematics, the mean score for the sample went from 44.0 
(October) to 46.4 (May). The objective was not attained, since ' 
the average gain was only 2.5 NCE units. From 1976 through 1979, 
mean gains in Mathematics were about ten NCE units each year. 
(Further analysis of these results yielded 't = 2.pi5, indicating 
that *the pre-post mean change showed at least, minimal [p<.05J 
statistical significance.) 

Available intimation indicated that' the intensity of instruction 
during 1979-1980 at least equaled that of previous years. The 
lower gains, thus, may have been attributable to pupils 1 having 
had approximately six fewer weeks of instruction between pre- and 
post-nesting. ' * 

, 0 



!_: Children will show significantly higher (b\<.05) 
r ioiency, emotional maturity, social skills and 



Product Objective 2 : 

levels of self-sufficiency, emotional maturity, 
*se If -concept at the end of the year, as compared to project entry, 
the Levine-Elzey rating scale.... 



on 



. Outcome : This objective was attained. . \ 

In October, -1979 teachers completed the Levine-Elzey Preschool 
Social Competency Scale for .a project -wide sample of children. In 
May, 1§80 this procedure was repeated, and pre-post ratings were 
scored on the four factors noted in the objective. % 

Application of the t-test .to these results indicated that the pre- 
. post gains in all four areas were statistically significant (p<.001) 
at a level beyond that proposed. (See Appendix E for pre-post data.) 

SUMMARY AND CONCLUSIONS • 



The 1979-1980 school year was replete with unique and unpredict- 
able events affecting al*l project operations. Most notable were the lengthy 
work stoppage (which resulted in schools' being closed from ^November 1\ 1979 
until January 4, 1980) and court-ordered (Jesegregation--implementation of 
Phase I (Fall, 1979) and Phase II (March 17, 1980); pxeparationr for Phase 
III implementation (Pall, 1980). Despite these conditions, the three pro- ^ 
cess objectives were attained. The cognitive product objective was at- 
tained in Language but not in Mathematics: gains in both areas* lower than 
recent years may have been attributable to the shorter than usual period of 
instruction between pre- and post-testing. The affective product objective 
was attained. 

Findings for 1979-1980 and previous years suggest that the pro- 
ject staff should:* . 

. continue to design ihd implement cooperative efforts to optimize t 
participating children's likelihood of success in* future schooling; 

~ . •. . - 10 - ^ ' IS 



maintain efforts to extend/intensify utilization of instruments 
for systematic observation of child behavior, classroom procedures 
etc.; " r 

in consultation with the evaluator-- 

. develop realistic criteria %o be incorporated into process ob- 
jectives , * 

revise instrumentation for establishing project eligibility and 
assessing attainment of product objectives. 
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* APPENDIX A 



CHILD DEVELOPMENT 
1979-1980 



LIST OF SCHOOLS 



4 



Alfred A. Benesch 

Anton Grdiria 

Bolton 

Boulevard 

Buck eye -Wood land • 

Capt. Arthur Roth 
Case 

Charles H. Lake 
Charles Off 
Charles W. Chesnutt 

Chesterfield 
Daniel E. Morgan 
Dike 

Do an . s 
East (SHS) 

East Clark ■ * 
East Madison 
George W. Carver 
Giddings - 
Glenville (SHS) - 

Gordon 
Hazeldell. 



Henry W. Longfellow 
Hicks 

Iowa-Maple s 

John D. Rockefeller 

John W. Raper 

Joseph F. Landis 
Longwood 
Louis Pasteur 
Margaret A. Ireland 
Mary B. Martin 

Mary M. BethunS 
Marion-Sterling 
Miles Standish 
i Mount Pleasant 
Orchard 

$ 

Paul L. Dunbar 
Paul Revere 
Scranton 
Steph*a-E*-^fowe~ 
Tremont 

Wacle Park 
Woodland Hills 
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APPENDIX B 

EARLY CHILDHOOD EDUCATION CLASSROOM STAFF SURVEY: JUNE, 198D 
CHILD DEVELOPMENT TEACHERS (N=32) 



AT 
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•APPENDIX B 



1. 




Whe/ie comments ok explanation* cjie a*ked, please, pKint ok dkite. 
vvuf legibly, u*ing only the *pate pKoviktd. Ml otheA Ke*pon*e* 
*hould be indicated by manking X in thz appKopKiat^ box ioK each 
ityn. il*e a ball- point ok "HaJut* pen, ok a *h^ip, dank pencil. 




About how many of your pupils have 
you consulted this year with: 



PER CENT 

U*e the*e heading* to indicate the 
munbeA o& pupil* £ok each item. 



none 



one 



2-3 several all 



\ 

OMIT 



.'"qther Early Childhood teacher (s) 


(01) 


6.3 


12. 


5 


15.6 


25.0 


40,6 


0.0 


i 

. first-grade teacher(s)? . * 


(02) 


50.0 


3. 


1 


25.0 


9.4 


0. 


0 


l'?.S 




(03) 


6.3' 


34. 


4 


2^1 


21.9 


3. 


1 


6.3 


. Early Childhood supportive services: 
















• 


. consult, tchr. /reading spec,? 


(04) 


6.3 


6. 


3 


37.5. 


34.4 


9. 


4 


6.3 




-Cos) 


50.0 


18 


8 

* 


15.6 


6.3 


0. 


0 


9.4 




(06) 


3.1 


9 


.4 


31.3 


43.8 


9. 


4 


3.1 


- v . 4 

1 > /- • 


(07) 


6.3 


6 


.3 


25.0 


43.8 


18 


8 


0.0 


0 

. school's "regular* 1 support staff: 










f 












(08) 


0.0 


» 6 


.3 


21.9 


40.6 


25 


.0 


6.3 




(09) 


50,0 


18 


.8 


9.4 


6.3 


0 


.0 


1576 




(10) 


43.-8 


9 


.4 


6.3 


18.8 


9 


.4 


12.5 




(H) 


59.4 


18 

4 


.8 


6.* 


3.1 


0 


.0 


6.3 


. parerft/family represent ativet .... 


.(12) 


' .914 


12 


.5 


12.5 


1*2.5 N^0 


.-6 


12.5 



other— Identify. 



2-a. For approximately how many jrapils , 
this year has a parent or other v, 
family representative: e 

♦ conferred with you at least once 
(other than "intake, 11 eta.)? •••« 



fc U*e the*e heading* to indicate the 
^ numbeA oj pupil* ioK each item. % 

about 
half 

25. 0 53.1 0.0 
/ 



non& 
C13) 0.0 



. conferred with you as often 
as once a month? (14) ^3.1 

'-Lcontuwtd] 



1-2 several 
0.0 21.9 



all OMIT. 



15.6 43.8 



31.3 3.1 . 3.1 



ERJC 
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- APPENDIX B (Cont'd) 



- l^YvUmzd) none 1-2 several - a ^£ all OMIT 

. attended at least one 
school -wide parent meeting? . (15) 0.0 34.4 37.5 28.1 0.0 0.0 

. attended at least one project/ 
Early Childhood special program? (16p 6-3 15.6, . 37.5 3J*.3 31.3 6.3 

. borrowed .materials to use • '~ / 

with childCuwi). at home? r (17) 28.1 31.3 37.5 0.0 0.0 3.1 

. visited in your classroonf'at \ . / 

.least once, to observe? "A (18) 0.0 0.0. 28.1 5&/0 21.9 0.0 

. worked on *a regular basis as a 
„ . volunteer in your classroom?' (19} 3.1 62.5 31.3 0.0 0.0 3.1 

. never "returned the call, 11 responded f * ^ 

to^n invitation, ^etc.? (20) 37.5 (^18.8 -21.9 12.5 0.00/ 9,4 

t ~* 
Describe briefly your major strategy this year for increasing parent involve- 
ment ini children 1 s education, especially by providing reinforcement during 
out-of-school hours/days. 



To the right of each activity listed, 

mark one box to indicate the extent li6Z thoAZ heading* to AJtoiLexLtz tht 

to which that activity— involved in . wphcUnti on Qjxch <6i6e/LV<tee topic. . 

the individualization of instruction-- 

was emphasized - in inservice this year r once-' now § , every 



individual, small-group, project -wide) . 


never 


twice 


then 


often 


time 


OMIT 


4 


(21) 


12.5 


12.5 


6.3 


37^5 


25 .•8 


6.3 




(22) 


18.8 
t 


9.4 


9.4 


25.0 


28.1 


9.4 


I 


(23) 


•15.6 

• 


9.4 


6.3 
* 


37.5 


25.0 


6.3 




(24) 


9.4 


- 9*4 


12.5 


31.3 


31.3 


6.3 




(25) 


9.4 


9.4 


21.9 


,28.1 


25.0 


6.3 


. understanding language development 


(26) 1 


0.0 


12.5 


6.3 


37.5 


43.8 


0.0 


. facilitating language gi*bwtp * . . . . 


(27) 


0.0 


12.5 


9.4 


31.3' 




0.0 


Mark one box at the right to indicate 














your oyerall rating 'of* this year's 






help- 




excel 




project-wide inseryice. , (Consider only 




use- 


"pretty 


OMIT 


those activities involving total staff, 


??? 


less 


ful 


good" . 


-lent 


at one time/place or in a series of , 












31.3 






(28) 


6.3. 


6.3 


25.0 


. 28.1 


3.1 



one two three four-- 



"^APPENDIX B (Cont'd) ^ 

-a. How .many times tihis school year tias a . 

consultant, teacher, reading specialist^ 2-3 4-6 7— 

curriculum coordinator and/or project . never once times times times OMIT 
manager observe^ project operations 

in your classroom? (29) O.CT (T.O j 21.9 45,8 31.3* 3.1 

-b. On how many oi these occasions was : 

none 

. the Classroom Observation 
Checklist u'sed? ,. (30) 3.1 . 78.1 12.5 0.0 3.1 ^ 3.1 

a post-observation conference/ j| 
. discussion helc^ with you?- .%31) 0.0 46.9 40-.6 6.3 ,0.0. 6.3 

To what extent has this year's in- 

. service — individual] (on-site)* and not ' * great 

small-.group, as well as project -wide at all some^ -ly * 

— provided for your own special and 

individual needsT^.TT....: ..(32) 6.3 0.0 37.5 18.8 34.4 3.1 

# 

Comments : . 



k 

For how manv, pupils this year areVou NUMBER OF ?U?TLS--£ok ITEMS 33-40 
vising each of the following "tools" 

Tor~monitoring individual progress? npne _ one two three 4-- OMIT 

. Class Assessment (complete) ...... (33) 15.6 3.1 ' 12.5-^ .3.1 46.9 18.8 

. Class ^Assess.— Visual'Skills only (34) 21.9 3.1 0.0 *6.3 50.0 18.8 

. Class Language Assess, (complete) (35} 21.9 0.0 15.6 3.1 37.5 21.9 

Individual Child Assess, (complete) (36) 12.5 6.3 18.8 12.5 34.4 15.6 

. Individual Prescriptive Program .. (37)25.0 Z.i 3.1 18.8 18.8 31.3 

. M%mil lan Language Assessment .... (33)65.6 0.0 . 3\l 0.0 0.0 31.3 

t PEEC Instrument .(SCOPE) JC39) 62.5 -^ 0.0 0.0 0.0 3.1 34.4 

'. TOBE Cla^Evaluation Record ...... (40)21.9 ^ 0.0 3.1 56.3, 18.8 

. other- -Identify.. 
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8. To the right of each developmental 
area listed below; mark in one box 
to indicate which t>f the descriptors § . 
most accufStely indicates -the ade- w 
quacy of you£ xecords of individual 'x 
chilcjren's progress in that area ' g* 
. this year. c 

h 

. jocial -emotional (41) 3 ^ 

. psychomotor (42) ^ 3 

language s.../...*...'. (43) Q Q 

. other cognitive. areas (44) qq 

Comments : - - / 



1 

5s 0 
u </> , 
0 c/> 
c/> 3 g 



0 i-t 

o ^ 
* A 
0 o 



(D OH 
X «H rrl 

6 <J h 
OOO 



T> >> 

0 «h g 

0"0 <H 



0 r-H 

•H 0$ 

^ P fn 

> m 



<^MIT 



0.0 34.4 25.0 18.8 - 18.8 0.0 



6.3 25.0. 28.1 12.5 18.8 3.1 



0.0 9.4 34.4. 40.6 ~ 15.fr, 0.0/ 
0.0 12.5 -34.4 2k£ 18.8 12.5 



9- a. Mark in the appropriate box to 
describe the extent to which you 
■ use PAP referral instruments (Ob- 
servation Guide..., Descriptive 
Behavioral Assessment) . (45) 



9-b. How helpful are PAP instruments 

(Observation Guide..., Descriptive 
Behavioral Assessment, TOBE...) 
in 'identifying children to-$e 
referred to the program? 



0 0 
0 tn 
C 3 

o o 

C -P 

25.0 



0 
> 
0 



1 

6 0 

3 s 0 0 

GOV) ^iH 

/ (ft 3 0 P Q« 

O U 6 V -t 

O0O O -H 0 , 

-P .O -P W H X 



o o 

O V) 



0 GO 

* c 

•H 

P4 > iN 
H»rl H 
0 0C 

,e u o 



P 
I C 

0 0 



9.4 40.6 15.6 



c 

•H 

iH C r-i 
0 0C 



0 
•p 

0 

rH 6 

o'.o 



OMIT 
9.4 



0 bo^bo 

•H J5 
O* > 0 
H 'H W 

0 0 . 
X O air 



(46) 3.1 21.9 3.1 31.3 18.8 21.9 



Comments : 



10. What one thing do £od intend to do again/better/differently next year to in- 
crease^the livelihood that project goals will be reached--and exceeded? 

c 



1 tt V* 



V 
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(tikeAtt comments ok zxplaffivtioni axz cUkzd,, pleabz, pKint ok wiitz 
vVuj Izgibly^tuing only thz 4>pacz provided. All otheA Kupon&eA 
6h0titd'ii& Indited by manking X in thz appropriate* box ion. each 
item. m LU>z a bolt-point ok "flcCut" pin, 'ok a^haxp, dank pencil. 




About how many of your pupils have 
you consulted this year with: 

. other Early Childhood teacher (s) 
and/or" teacher assistant (s) ? 



PER CENT *f 
U*z the* z heading* to indieatz- thz 
numbeA oj pupiZ* ioK each- it 



none 
(01) 8.0 



. first-grade teacher (s)? "(02) 44.0 

• principal? ... (03) 36.0 

\ Early Childhood supportive services: 

. consult, tchr. /reading spe*c.? (04) 16.0 

'. psychologist?^. ....Sf. (%5) 52.0 

. social worker? (06) **8.0' 

. sp^fech therapist? .t (07) 8.0 

schoor's "regular." support -staff: 

rse? 7 (08) 12.0 



one . 


2-3 


several 


all 


(to 


4.0 


20.0 


32.0 


28.0 


•8.0 


12.0 


12.0 


8.0 


8.0' 


16.0 


16.0 


20.0 


12.0 


8.0 


8.0 



28. 0 > 


16.0 


20^0 

" r 


8.Q 


12.0 


16.0 


16.0 


4.0 


0.0 


12.0 


20.0 


24.0 


28.0 


M 

12.0 


8.0 


16.0 


32.0 


28.0 


16.0 


0.0 



12.0 



ychologi'st'?. ' (09) 52.0, 12.0 



. speech therapist? (10) 32.0 

community agencies? .'. (11) 56.0 

. parent/family representative? .... (12) 20. 0 

..other— Identify. ' . 



12.0 
20.0 



16.0 
4.0 

~8.0 
0-.0 



32.0 20.0 
8.0 0.0 



24.0 
4.0 



0.0 
4.0 



4$\ 16.0 



16.0 24.0 



28.0 
24.0 
24.0 
16.0 
20.0 



Fpr approximately how many pupils 
.this year has a jparenfcgWr other 
family representative W 

* conferred with you at least bjicfc 
(other than "intake, 11 etc.) ? - •••« 



ttoe th&Az heading* to indAcatz tkz 
numbeA oj pupils 'joK each item. 



none 
<13) 0.0 



1-2 several 
8.0 24.0 



about 



all 



tfialf 

32.0 32.0 



\ conferred with you as often 
-.as once a month? .. * . . . * . . (14) 

.r ;~. ^ LcorttUnucd] 



f Q.Q 28.0* 32. « 24.0 12.0 



OMIT 
4<0 

4.0 
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APPENDIX C (Cont'd) 

half 



[continued] * " • none' 1-2 several a11 0MIT 



. attended at least one 

• school- wide parent meeting? (15) 0.0 32 . 4 0 36.0 '28.0 0.0 4.0 

. attended at least one project/ l*» * 

Early Childhood .special program? "(16) 0.0 24.0 40.0 28,0 4.0 . , 4.0 

. . borrowed materials to use * 

with child(ren) at home? (17) 32.0 24. 4 0 40.0 „ 0.0 0.0, 4.0 

. visited in youl^classroofh at 

least once, to observe? (18) 0.0 8.0 28.0 48.0 12.0 4.0^ 

. worked on a regula£ basis as a ' 

volunteer in your classroom? (19} 12.0 44.0 32.0 S.O 0.0 4.0 

° * 

. never "returned" the call," responded 

to an invitation, etc.? \. (20) 32.0 28.0 24.0 4.0 4.0 8.0 

2-b. Describe briefly your major, strategy this year for increasing pajr-ent involve- 
ment in children's education, especially by providing reinforcement during 
out-of-school hours/days'. 



To the right of each activity listed, _ 

mark one box to indicate the extent tMe tkoAt heading* to wdXvxZc the 

to which that activity— involy&d in emphaA<ti on each in&&wicz topic. > 
the individualization of instruction — 

was emphasized in inservi^e £ his year once- now § every 

^individual, small-group, project -wide) . never twice then often time OMIT 

. observing behavior ~(21) 4.0 16 .JO 4.0 52.0 16.0 8.0 

\ recording observations (22) 4.'0 20.0 20.0 28.0 '20.0 8.0 

. analyzing assessment data (23) 8.0 12.0 20.0 28.0 16.0 - 16.0 

* 

. prescribing instruction (24) 8..0 8.0 12.0 ' 36.0 24.0 12.0 

. 'implementing prescriptions ...*.... (25) .16.0 «.0 24.0 32.0 1*.0 8.0^ 

. understanding language development (26) 8.0 12.0 12.0 44.0 20.0 4.0 

/facilitating language groWth (27) 0.0 16.0 12.0 40.0 24.0 " 8.0 

\ 

Mark one box at thet right ^.to indicate 
your overall rating - of this year's 

project-^ide inservice.. (Consider only use- help- "pretty excel 

those activities involving total JfcSf* ? ?-? l eSs .ful good 11 -lent OMIT 



at one time/place or in a series lB9 



Of sessions.) *. .,..^F(28) 4.0 ' 0.0 28.0 28.0 40.0 0.0 
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5-al How .many times this school year has a 
consultant 'teacher/ reading specialist, 
curriculum coordinator v and/or project never once 
manager observed project operations 
in your classroom? (29) 0,0 4.0 

On how many of these occasions w^s: 

none one 

. the Classroom Observation 
Checklist used? * (30) 16.0 32.0 

• a post -observation conference/ 
discussion held with you? (31) 16.0 44.0 

6, To what extent has this year's in- 
service — individual (on-site) and not 
small-group, as well as project-wide * at all 
— provided for your own special and 

individual needs? (32) '4.0' 0.0 

Comments : . : 



2-3 4-6 7— • 
times times times 

20.0 44.0 32.0 



two 
20.0 



three four— 
16.0 8.0 



OMIT 
0.0 

8.0 



12.0 12.0 0.0 16,0 



great 

some -ly 
36.0 0.0 44.0 16.0 



ERIC 



For how many pupils this year are^k - 
using each of the following "tool^F^ 
Tor~mbnitoring individual progress?— 


NUMBER OF PUPILS— {on. ITEMS 33-40 
none pne two three 4- J 


OMIT 




'(33) 


12.0 


8.0 


8.0 


8.0 


52.0 


' 12.0 


. Class Assess.— Visual Skills only 


(34) 


8.0 


. 4.0 


12.0 


16.0 


44.0 


16.0 


m 

V 

. Class Language Assess, (complete) 


(35) 


4.0 


8.0 


8.0 


20.0 


52.0 


8.0 


. Individual Child Assess. (Complete) 


(36) 


0.0 


o.o N 


zo.o 


24.0 


40.0 


16.0 


. Individual Prescriptive Program .. 


•(37) 


16.0 


8.0 


12.0 


20.0 


28.0 


16.0 


. Macmillan Language Assessment 


(38) 


48,0 


8.0 


* 8.0 


4.0 


12.0 


20.0 




(39) 


52.0 


8.0 ' 


" 4.0 


0.0 
t 


12.0 


24.0 


. TOBE Clay Evaluation Record 


(40) 


12.0. 


■ 

4.0 


„ 8.0 


8.0 


£2.0 


. 16.0 

c 


. other- -Identify. 












* 
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8. $0 t}ie right of • each developmental * 
area listed below,, mark ixKpi}^ box 

to indicate which of the descriptors © r Jt 

most accurately indicates the ade- , t> b x © *© ^1 Soh^oc 15 

quacy of your records of individual x : u ia jj' *h o » * -h « © .h g * 

children's progress m that area c * ©w epm-hp^^p^ _ 

* • r & ;* o ^crt©o o©.03©oo©p OMIT 

this year, •» c y> a 3 g *a m a wnrfm o-t> m > *a <« 



• social -emdmonal (41) 0.0 " 12.0 * 12.0 ,24.0 8.0 36.0 8.0 

• psychomotor (42) 0.0 4.0 12^0 40.0 8.0 24.0 12.0 

' * -* 

. language (43) 0.0 0.0 12.0 20i0 24.0 24.0 *20.0 



. . other cognitive areas *C44) 4,0 0.0 12.0 28.0 24,0 20.0 12.0 

'Comments : s [ . ' 

9-a. Mark in the appropriate box to "g „ ( 3 Q > J2 k . 

. describe the extent to which you • " e 3 © « e t.c ^ © i . 

use PAP referral instruments (Ob- . QO > 8-8 8 § 34? omtt 

'. JirVation Guide..'., Descriptive * e *> c o </>'<« cr * * UM1 - 1 

, "Behavioral Assessment) (45) 16.0 8.Q 44.0 16.0 , 0.Q 16.0 

■ i . i , i ♦ *■ 

ft.4). How helpful are PAP instruments § g 0 0 g ^ : ^ g 

(Observation Guide..., Descriptive ° 8 3 *©7l p, p«> x p,tj >;*p/> § 

Behavioral Assessment, TOBE/. .) aoooSoooeooc©'©' 0 , 

in identifying children to be. ^ -° ^ w ~ .e .coo .c w o .e u «r| 

referred to the program? .... . .. (46) „4.0 16.0 4.0 24.0 28.0 24.0 

Comments : 

10. What one thing dc* £ou intend to do again/better/different'ly next year to in- 
crease the likelihood that project goals will be reached— and exceeded? " * 



appendix. 
child development: 1979-1980 
. tests of Basic experiences , level k 

(N = 205) 



PRE- (10/79) ' POST- (5/80) 

TEST ^ MEAN* S.D. %-ILE** MEAN* S.D. %-ILE** 

— — : : ^ " 



MEAN 
CHANGE 



SIGNIF. 
LEVEL 



Language 



40.2 14.4 33 



rtsthematlcs 44.0 15.5 40 



49.4 19.8 ■' 48 + 9.2 6.708 p<.001 

46.4 16.8 43 +2.5 2.015 p^.OS 



♦Means are expressed in\NCE units based on national norms, described below. 
-♦♦Percentiles are national, norms: prekindergarten for the pre-test, kindergarten, for 
the post-test. . ' s$ 
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i 

CHILD DEVELOPMENT : N 1979-1980 



LEVINE-ELZEY PRESCHOOL SOCIAL COMPETENCY SCALE 
(N = 203) 

s 

f ' . 



FACTOR 


PRE- 
' MEAN 


(10/79) 
S.D. 


' POST- 
*MEAN 


* 

(S/80) 
S.D. 


/ ., 


SIGNIF. 
LEVEL 


Self-sufficiency 


2. 58 


.60 


3.12 


.57 


12.194 s 


p 4..0W^ 


Emotional Maturity 


' 2.79 


. .61 


3.22 




9.796 


p<: .001 


Social Skills 


2rS3 


.57 


3.19 


.53 


14.811 


p<".001 


Self-concept 


2.83 


.53 


"3.11 


.56 


6.385 


p ^ .001 

• 

* 
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CHILDREN IN RESIDENTIAL SCHOOLS 



' * Prepared by 

Francis D. Sullivan, 
Consultant Teacher 



Typect by 
Mary E. Logan 



Marg)£ret Fleming * 
Deputy Superintendent 



1979-1980 



CHILDREN IN RESIDENTIAL SCHOOLS 



1979 -80 Title I Evaluation 
z 

PURPOSE AND OVERVIEW 

This program is designed' to provide additional instructional - 
and supportive services to neglected or delinquent children residing at . 
the Cuyahoga County Youth Development Center. The institution maintains 
an on-grdunds, formal educational facility, Harry L. Eastman School, 
operated by the Cleveland Public Schools. As institutionalized, neglect- 
ed or delinquent youth, the resident students are automatically eligible 
for Title I services which include, in this case; ipdividualized and ^mall- 
group general tutoring services in school subjects, remedial reading in- 
struction classes, and school adjustment counseling. "Additionally, the 
program provides tutoring services to children in four institution^ — 
Cleveland Christian Hom^'Ohio Boys 1 Town, The Jones Home for Children's 
Services, and Metzenbaum Children's Center — which do not have formal 
^ifehool programs and whose residents attend assigned Cleveland Public 
Schools, and/or nearby non-public schools. , } 



SERVICE SUMMARY 

Number of Pupils Served : 366 Grades Served : 1-12 

y Number- of Scfrgfcls ;y ^school and - * Years In Operation : 13 

^4 residential institutions* 

Staffing : 9 teachers (FT) 

Total fritle, I Expenditures : $249, 5^0 Per-Pupil Cost : $681.20 

' OBJECTIVES AND OUTCOMES * 4 

. Objective 1 :. Cuyahoga County Youth Center 

Teacher-tutors will assist students by providing information 
relative to good grooming and improvement of grades and attitude 
toward school. 

. Outcome 1 : pbjectiye 1 has been attained. Project records 
indicate that at the Cuyahoga County Youth Development Center, 
th.e fallowing services were provided. 

Career Education Classes 146 pupils 
Tutoring in Nursing Skills • 'V 

, . for Health Centers ' 94 pupils 

Clothing Instruction 70 pupils 

Physical Education 133 pupils 

' % , 443 pupils* 

♦Duplicate^ Count * 
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Including the 100 students who participated in Title I Read- t 9 
ing Classes, the project provided service to 274 pupils (undu- 
plicated count) at the Cuyahoga County Youth Development Center. 
t {Se& Appendix A). Instructional units taught in these classes 
included information regarding good "grooming and improvement 
of grades and attitude toward school. <, 

Objective 2: Cuhahoga County Youth Center ;* 
For students receiving at least six months 1 seryice at the Cuyahoga 
County Youth Center, a gain of 2 NCE units will be. observed from., 
pre to post as measured by the pre/post administration of the Compre- 
hension Subtest of'^the Stanford Diagnostic Reading Test. 

. Outcome 2 : Objective 2 has been attained. 'A total of 100 students 
participated in the Title I reading classes during the school year. 
Because of the entry and leaving pattern at the institution, 38 
^students received the six months 1 se,rvice specified in the objec- v 
* tive. * The average rank of the students entry in the program as 
shown by the results of the. Comprehension Subtest of t?he Stan- 
ford Diagnostic -Reaching test was 32.3 NCE units (20th percentile). 
Posttreatment scoffs *using the same test show an increase t„o 37./4 
NCE units (27th percentile) in the average rank of the students.. 
The students posted a Pre-to-post gain of 5.1 NCE units. See 
Appendix B, p. 6. Table I presents the pre and post service 
data by g^ade of 38 students at Harry L. Eastman School. 

» * 

> 

Table 1 3 

Mean Group Gains of 
Seventh, Eighth, Ninth, and Tenth Grade Part^/ipants 
at Harry L. Eastman School Stated in Normal Curve Equivalents 
(Stanford Diagnostic Reading Tests, 
Comprehension Subtest) 

✓ 

*i = 38, " 













/~ Pretest 
^Average 


Posttest 
Average 


Mean 
Gain 


Grade 


N 


NCE 


%ile 


NCE 


%ile 


NCE 


7 


9 


39.0 


30 


40.8 


33 


1.8 


' ' 8 


13 


31.8 


/l9 


37.1 


27 


5.2 


9 ' 


12 


28.7 


15 


36.2 


25 


7.4 


10 <l 


4 


29.7 


16 


3S.3 




5.6 


Summary 


38 


32.3 v 


20 


37.35 


I 27 


5.0 




Objective 3 : Cuyahoga County Youth Center 

Corrective reading classes, speech therapy, and psychological services 
will be provided as needed to students with reading, -speech, or 
psychological problems. ~ 

. . Outcome 3 : Cuyahoga ^County Youth Center 

Objective 3 has been attained. Since all institutionalized, 'neglect- 
ed or delinquent children are eligible for Title I service, selec- 
tion of students for, project reading classes was based on demonstra- 
tion of greatest .need as shown by pretest resists (See Outcome 2 
for details.) Project records document that 100 students who 
were served by the project during their stay at the institution 
received instruction ^on a dai«iy bisis in formal corrective reading 
classes. The^ classssa were taught by a Title I' staff reading 
specialist who used a variety of materials purchased by the program. 
An additional 110 students received informal tutoring aid in the 
areas of basfc reading and English language skills from a Title I- 
, teacher-tutor. Tl\e institution provided therapeutic psychological 
services called tb^e Positive Peer Culture Program; no referrals 
for speech therapy or psychological services for students beyond 
those offered by the institution have been documented. 

Objective 4 : Institutions Receiving Tutorial Services ' . 
Teacher- tutor personnel will be* assigned to each of the four institu- 
tions delivering the^f ollowing amount of service: 

Cleveland Christian Home- -part time < 
Ohio Boys 1 Town — part time 

The Jones Home of Children's Services—part time 
Metztenbaum Children's Center — as needed 

. Outcome 4 : Objective 4 has been attained. Project records document 
* that personnel wei^| assigned as* specified. 

Objective 5 : Institutions Receiving Tutorial Service ? 
Pupils will be identified and referred cooperatively for tutorial 
help by the institutional staff and the student^ 1 regular classroom 
teachers. JfcA 



Outcome 5 : Objective 5 has been attained. The project emphasizes 
providing assistance tb institutionalized students in the areas of 
reading and mathematics although help is given as needed in other * 
school subjects. -Title ^1 provides service yd the fomyof individual- 
ized or small-group tutoring sessions held m the institution after 
school hours. • Seirvice can be initiated by tedchers in the school 
the student attends, or the student can be self-referred to the Title 
I teacher- tutor. Project records indicate that the following numbers 
of students were ^erved in the four listed institutions: 



v 
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Institution^ 



Number of 
Students Served 



Jones Home 
Ohio -Boys' Town 
Cleveland Christian Home 
Metzenbaum Children's Center 



26 
23 
15 
28 

92 



SUMMARY AND CONSLUSIONS 



Children in Residential Schools is a Title I project designed 
to provide supplementary assistance to institutionalized, neglected and 
delinquent children • The program Operates in two strands serving Harry 
U ' Eastman^chool at the Cuyahoga County Youth Development Center and 
four resi<3^Kes whose children attend on-gTOunds classes, assigned Cleve- 
land Publi^Schools, and/or nearby non-public schools. The program 
concentrates on providing additional help in mathematics and reading ■ 
through classroom instruction at Harry L, Eastman and tutoring in four 
residences. All the project objectives have been ^attained. The follow- 
ing recommendations were made: 

. Th^jy:oject should be continued and expanded to other institutions, 

• Objective 2 at Cuyahoga County Youth Center should be modified 
to read, as follows: For students receiving the equivalent of at 
least one s^jnester's service at the Cuyahoga Youth Center, a gain 
of 2 NCE units will be"' observed from pre-to-post intervention as . 
measure*! 6y pre/post administration of the Comprehension Subtest 
of the Stanford Diagnostic Reading Test (Brown Level) • „• 

Documentation of Title I services to student participants should 
be submitted to the project* manager and project evaluator on a 
monthly basis in order to provide continuity to the evaluational 
process. * 

/ 
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' APPENDIX A 



CHILDREN IN RESIDENTIAL SCHOOLS 



Number of Students Served by Grade and -Institution 

(July, 1980) 















GRADE 










• 






INSTITUTION 


K 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 




Cleveland 
Christian Home 




2 


3 


5 


1 


3 




1 












•15 


Metzej^baum 
Children 1 s 
Center * 








* 








8 


11 


9 






* 


28 


Ohio Boys 1 
.Tovm 










s 




1 




7 




9 


3 




" 23 


The Jones Home 




3 


3 


1 




4 


3 




3 










26 


k> " 1 

Youth Development 
Center * - 






\ 






4 


8 


39 


61 


70 


68 


21 


3 


i 

274 


TOTAL 


\ 


5 


6 


6 


10 


11 

_1_ 


12 


;si 


82 


79 


77 


24 


3 { 


366 



( 
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APPENDIX B 



1 



Summary of Reading Data 
ETalnitioa for R«gul*r School Ytar Progrw Only. ' Pltut riport by gradi 



« 

Gradt 

Llvll 


Test 

Pnrl» 


Nuaber of 
Scores - 


To til Net 
NCE Gain 
Points 

nsuwi wou 


Average 

NCE Gain 
Col. D 
4 

Col. C 


> 

At e rag t 
Pretest 

NCE 


• < 

Average 

Poatteat 

NCE 


Nuaber^ of i 
Participant a • 
Who Gained 
♦7 NCE or 9 
Hore 


Number of . 
Participants 
is Col* C 
From 

Private , ■ 
Schools * «" -a 




B 


c 


D 




F 


0 


H 


' i 


Pr*-K 












> — 






K 


















1 














0 




2, 






















■ 


: i 






* 






4 








































ii 


















• 9 


16.2 


1.8 


39.0 


40.8 




o 


8 




• 13 • 


68.2 


' 5.2 


31.8 


37.1 ' 


5 ' 


0 " 






12 


89.1 


7,4 


28.7 


36.2 


7 


0 


10 




4 


22.1 


5.5 


29.7 


35.3 


2 


0 


' 11 « 


















12 
TOTAL 




38 


195.6 


e 




. 


— ~7 

17 


0 



AVERAGE NCE GJUH FOR TBS PROJECT 
(Total Col. D* Total Col. C) 



5.147 



NUMBER OF PARTICIPANTS OKITTED FROM GROWTH DATA 

25.1 misting preteat or poatteat 

'25.2 prtttst and poatteat sot comparable 

250 tastad at" inappropriate dataa 

25.4 insufficient time in project 

25*5 other: Explain 



62 



TOTAL NUMBER OF PARTICIPANTS 0 KITTED 




62 



er|c 



39 

mm 
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CLEVELAND FUNDAMENTAL, SCHOOL * 
BASIC SKILLS REINFORCEMENT PROJECT 



Prepared by 

Ella Cleveland 
Consultant Teacher 



Typed 
Constance Brewton 



Margaret Fleraijig 
Deputy Superintendent- 




1979-1980 , * 



• CLEVELAND FUNDAMENTAL SQjOQL BASIC SKILLS REINFORCEM ENT PROJECT 
1979-80 Title I Evaluation 



PURPOSE AND OVERVIEW 



, .The purpose of the project is to provide specialized small- ' 
dtp instruction for* pupils experiencing difficulty in mathematics or. 
. Xxbadine. Pupils eligible for this service receive remedial assistance 
* r from the project staff within the confines of a special resource center 
designed for this intensive instruction. .Each day, the students 'leave 
; their regular classrooms and participate in carefully planned activi- 
ties, individual or small-group, for forty minutes. m — ; 



f 



SERVICE SUMMARf 

* 

„ Number of Pupils Served: 150 
NumbttP-txg, Schools : 1 Public 



Grades Served :y . 1-6 



Years in Operation: 1 




Staffing: 1 Project Manager, PT 

2 Reading Consultant Teachers, FT 
1 Math Consultant Teacher, FT 
1 Teacher Assistant, FT 



Total Titly Expenditures: $66,214' Per-Pupil Cost: $441 



OBJECTIVES AND OUTCOMES 



9 



Objective 1: The reading skills of participating pupils in grades two 
4*hrough six will improve as evidenced by an increase of at least foufc , 
NCE units on standardized reading tests administered prior to and foi^ 
losing pr&ject participation. v * 

\ Outcome: Objective 1 was attained. The Comprehensive- Test of Basic 
Skills (CTBS) Reading Comprehension sub-test was administered to all 

* participating pupils in grades two through six on a pre-post -basis 
in February arid June, 1980. Examination of the test scores sfiows that 
the average increase in NCE units on' the standardized reading tests 
was 8.9 t l for grades two through six. The objective criterion was met 

[ with each ferade level except 3. NCE tinit gain by grade level is pre- 
sented in the following table. * 
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MCE UNIT ,GAlN 
Reading Comprehension 



j 



Grade 


n - 
pupi Is 


Level and Form 
. of Test 


Pre . 
Test 


Post 
Test 
Date 


Treatment* 
■ Time 
(weeks) 


Average Pre/Post NCE 
Difference-. 


2 


IS 


* 

Level C, Form S 


2/80 


6/80 


18 


+ 


23.85" 


3 


20 


Level. i, Form S 


2/80 


5/80 


15 


+ 


0.97' 


4 


12 


Level 2, Form S 


2/80 ' 


5/80 


14 


> + 


7.69 


' 5 


27 


Level 2, Form T - 


2/80 


5/80 


13 


+ 


8.69 


6 


10 

i 


.Level 2, Form S 


2/80 


5/80 


13 


♦ + 


4.45 






y 














84^ 


* 


+ 


8.91 



Average 



The objective criterion standard was stated in terms of NCE uni$s. 
The following table will enable the reader to see the pupil standing repre- 
sented by percentile ranks, base6 on national norms and relative to students 
of the same age. 



PERCENTILE RANK 



Reading Comprehension 



Grade 


Pre. Test 


Post Test 


2 


18 


51 ^ 


3 


19 


20 * 


4 


16 


23 


5 


22 


36 


6 


' 27 ' 


34 



It may be concluded, from the percentile d&ta, that, the /students 



served by tfiis project in reading started at very low percen 



and experienced some growth after treatment* 
for grade 2 pupils* 




ankings 



,The growth is most noteworthy 



Objective 2: The, mathematics skills of participating pupils in grades 
two through six will improve -as evidenped by an increase of at least 
four NCE units on standardized mathematics tests. 

. Outcome: Objective 2 was 1 attained. All participating pupils in 
grades two through six completed all math subtests of the CTBS 
on a pre-post basis in February and June, 1980. The increase in 
NCE units on the tests averaged 16. 18^ for grades two through six-- t 
The%e data are show in the following table. ^ ■ 
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NCE UNIT GAIN 
Mathematics Total-Score 



.Grade 


n 

-pupils 


Level "and Form 
of Test 


Pre 

Test 

Date 


Post 
Test 
Date 


Treatment 
Time 
(weeks) 


Average Pre/Post NCE 
Difference 


2 
3 
4 
5 

. 6 


6, 
10 
12' 
12 j 

8 


Level C, Form S 
Level 1, Form A S 
Level 2, Form S 
Level 2, Form T 
n,evel 2, Form S 


2/80 
10/79 
2/80 
2/80 
2/80 


6/80 
4/80 
5/80 
6/80 
3/80 


18 
11 
15 
16 
7 


+ 6.25 
+ 7.96 
+ 23.45 
+ 21.77 
+ 14.59 


Total/ 


48 




+ 16.18 



Average 



Pupil standing in Math is presented, in the following table,, by 
the use of percentile ranks. 



PERCENTILE RANK 





Mathematics 






Grade 


Pre Test 


' Post Test 












2 


9 


15. 




? 


v 17 


28 




4 


9 


42 




5 


8 


37 




6 


13 


33 


♦ 



i Pupils pretested, before treatment, ranked very low in terms of 

percentiles-? — All grades experienced growth in percentile ranks following 
treatment, especially grades four and five. 

. Objective 3: Product Staff will maintain communication with classroom 
teachers throughout the project .year to facilitate improvement in^ 
* . reading and mathematics as evidenced by. 70 percent 6f participating 
f teachers providing a positive rating of usefulness of information/in- 

service resulting from their contact with project staff. 

. Outcome: Objective 3 was achieved. .A teacher reaction sheet may be 
found in Appendix A. This teacher opinionaire measured classroom 
teacher's reactions to the usefulness o£ service, information, and 
inservice provided ifr Title I staff. Teachers were asked to rate 
Title I services along the following dimensions: techniques used 
and -the success o^service#*4fVel of communication between class- 
room teacher and consultant teacher regarding pupils served, and » 
"value or practicality of irisefvice sessions provided by Title I 
staff. SixVeeh of the twenty teachers or 80% completed the survey. 




Of the teachers -returning surveys, 100% provided positive ratings 
(i.e., an average rating of 3 or above). The following table 
shows that; on a scale from 1-*, .(five representing the most posi- 
tive response) the Title I teathers were viewed as. providing very 
useful services. 



Classroom Teacher Reaction 
to Project Service * 







Average Rating of 




n 


Service 


Grade Level 


teachers 


Reading 


Math 


Primary 


8 , 


4.6 


4.6 


Upper * 


8 


4.6 


4.4 



5 



ADDITIONAL FINDINGS ~ 

# 

Actional information related to project operations is summarized 
below* The information was derived from examination of project records and 
observation -of project operations. * 

Rupils recommended by the regular classroom teacher for participa- ^ , 
$ ^\pan t in the project had to meet the following selection criteria: 
rformanGe at or below the 33rd percentile on the reading compre- 
hension and/or any riath subtest of the following tests: the Metro- 
v poMtan Readiness Test (grade one), Stanford Diagnostic Reading or 
Matll Tests (grades two and three) , or the CTBS from the previous 
year (grades four-^ix) . 

. It was found\ during 'the screening process, that approximately 2S0 
pupil? (45%) bf the 550 enrolled at the school qualified for Title 

I services, that is, they scored at or below the 33rd percentile 

eon the standardized tests. The result's of the screening, process re- 
sulted in service to pupil* (n=151) scoring at' or below the 20th 
nsrcentile, because thereVwere not enough staff to serve all eligible 
/pupils. , ^ . . 

. Each Consultant Teacher serviced approximately fifty pupils each day 
(range = 47-55) . During each of the seven forty-minute periods per 
day, an average of seven pupils were served (range « 3-9). The sites 
for instruction were in the Title I Resource Room apart ftrom the & 
pupils 1 regular classroom. ■ 

V t - 

. The Title' I Staff planned and implemented 4^ hours of inservice (the 
* proposal called for 4 hours) for the classroom teachers. Subject 
matter supervisors assisted with the sessions, which included explana- 



tion of the new Metric Center and various general orientation ses- 
sions* Also*, voluntary* reading workshops were held on six separate 
one-haJ.f hour morning sessions. 



SUMMARY -AND CONCLUSIONS 

' In its first year of operation, the Cleveland Fundamental 

jSchool Basic Skills Reinforcement Project has ^provided a service that 
addresses the remedial needs \of students and is perceived as valuable 
l}y the classroom teachers of (these students. The project has achieved 
all three of its proposed objectives. Test data reveal that the pupils 
served by this project/ gained an average of 8.91 (Reading) and 16.18 
(Math) NCE units, exceWing/the proposed gain of 4 NCE's. The class- 
room teachers rated thi^pyogram highly, assigning ml average jrating of 
4.6, on a scale i of 5. ^ , " ^ 

♦ 

. It is recommended that consideration be given to increasing the 
professional staff of the project, i.e., hiring an additional 
Consultant Teacher. As noted before, there are many other stu- 
dents at the Fundamental Education Center who could benefit from 
these special services. 
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^ APPENDIX A 

TEACHER REACTION SHEET 
BASIC SKILLS REINFORCEMENT PROJECT 
- TITLE I - 
FUNDAMENTAL EDUCATION CENTER . 



r 



Directions : 



Please give your impressions of the usefulness of service, information, 
and inservice resulting from your contaot with the Title I project 
staff (Reading: Mrs. Victory - grades 1-3, Ms. Stephens - grades 4-6; 
Math: Mrs. West). Circle the number along each continuum which most 
closely represents your feelings concerning each item. Note that a 
"5" represents the most positive response, while a fc "l" represents the 
most negative response. 



4- 

SERVICE TO STUDENTS 



Grade 



PURPOSE FOR TREATMENT WAS • 
CLEAR 

METHODOLOGY FOR TREATMENT WAS 
CLEAR • 

SERVICE BENEFICIAL 



Reading 5 4s 3 2 1 

Math S 4 3 2 1 

Reading S 4 3' 2 1 

Math S 4 3 2 1 



PURPOSE FOR TREATMENT WAS NOT 
CLEAR 

METHODOLOGY FOR TREATMENT WAS 
NOT CLEAR 



Reading S 4 3 2 1 * SERVICE NOT BENEFICIAL 



INFORMATION SHARED WITH YOU RE: STUDENTS 



NUMBER OF CONTACTS WAS ADE- 
QUATE 

INFORMATION SHARED WAS VALU- 
ABLE 



Reading. S 4 3 2 
Math S 4 3 2 



Reading 5 
■Math S 



WAS ABLE TO ACT ON INFORMATION Reading ' S 
SHARED « Math s 



G ROUP INSERVICE SESSIONS 

Reading S 



SESSIONS WERE WORTHWHILE 



NEW KNOWLEDGE ACQUIRED AT 
SESSIONS 

TIME ALLOTED FOR SESSIONS WAS 
SUFFICIENT 

INFORMATION SHARED WAS PRACTI- 
CAL 



Math 



4 
4 

4 
4 



4 
4 



3 
3 

3 
3 



3 
3 



Reading 5. 4 3 

Math S*'4* 3 

Reading 5 4 3 

,Math S 4 3 

Reading S 4 3 

Math S 4 3 



2 
2 

2 
2 

2 
2 

2 
2 



1 NUMBER OF CONTACTS WAS INADE- 

1 QUATE 

1 INFORMATION SHARED WAS NOT 

1 VALUABLE 

1 WAS NOT ABLE TO ACT ON INFORMA- 

1 TION SHARED 



1 SESSIONS NOT WORTHWHILE 
1 

1 NO NEW KNOWLEDGE ACQUIRED 

1 • SESSIONS 

4 

1 TIME ALLOTED FOR SESSIONS WAS 

1 INSUFFICIENT 

1 INFORMATION SHARED WAS IMPRAC-' 

1 TICAL 



Comments : 
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DIAGNOSTIC READING CLINIC* 

♦ 

/ 

% 

Prepared by 

Richard Leiken 
Consultant Teacher 

Typed by 
Arlene Copeland 

• 0 

Margaret Fleming 
Deputy Superintendent 



DIAGNOSTIC READING CLINIC 

1 

1979-80 Evaluation 



PURPOSE AND OVERVIEW 

The Diagnostic heading Clinic is designed to provide specialized 
in-depth service to pupils evidencing multiple and complex reading diffi- 
culties in the uppef elementary grades. One hour per day of instruction 
for 6 to 36 weeks is provided for elementary children who are 'transported 
to the Diagnostic Reading Center. The Reading Clinic staff reflects inter- 
disciplinary skills, and conducts specialized reading instruction related 
to individual pupil -diagnosis. All diagnostic and remedial information 
is made availabl^to classroom teachers. Also emphasis is placed on 
parental involvement in support of pupils reading efforts. 



SERVICE SUMMARY 



Number of Pupils Sgrved : 1,255 



Grades Served: 4,^5, 6, 7 



Nunfogf of Schools : 59 public 

~ — 3 non-public 

See Attachment B 62 total 



Years in Operation : 16 

(14.5 yrs. - Title I; 1.5 yrs. - 0E0) 



Staffing: 25 Teachers," FT 

3 Psychologists, FT • 
1 ^ 2 Coordinatdrs , FT 

1 Nurse, FT ~ Xs *-v 
8 Teacher Aides, FT* 
" 2 Secretaries/ fT 



8 Drivers, FT 
4 Psychologists, PT 
# *1 Speech Therapist 
1 Supervisor ^ 



Total Title I Expenditures: $1,048,321 



Per Pupil Cost : $835 
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OBJECTIVES AND OUTCOMES 



Objective 1 : Pupil participants will evidence a post treatment mean 

score (on a standardized reading test) that is at least two NCE units 

higher than the mean pre-test score. 

; , / 

. Outcome 1 : The objective was attained , A comparison of 115 pre- 
post test results selected randomly realized an average gain of 
24.2 NCE units. Forms B, C, and D of the Gates McGinitie Primary 
Reading Service were used. Selection of the appropriate test 
level was based on the students oral reading placement score from 
the Gates McGinitie Diagnostic Test which was administered as part 
of the diagnostic plan. 

Objective 2 : As reported by classroom teachers, at least two out of. 
three pupils receiving full' service will evidence observable independent' 
performance with classroom reding materials at least h$lf of the time. 

^, Outcome 2: The objective was attained. A teacher questionnaire was 
submitted to* the teacher of a participating student in each of the 
1 64 project schools. The purpose oft the questions was to evaluate 
to what extent students had taastered reading material' for his or - 
her grade l,evel. Thirty seven teachers responded to the sample survey. 
Analyses of responses to item ten which sought the degTee to which each 
selected student could master the reading material for his grade 
yielded the following results. Teachers believed that 87% of the 
students Gould s iw«rale the usual reading material used in his girade. 
(See attachment A for results) 

• Objective 3 : Pupils will receive the coordinated services of related dis- 
ciplines in the diagnosis and correction of reading difficulties. . 

. Outcome 3 : The' objective was attained . Records for each student 

served by the project are kept at the Diagnostic Reading Clinic Office 
at. the Observation School. All students upon entering the progTam 
are given psychological testing services if they had not been tested 
for a minimum of two years. All project students are alsq given 
' - a speech and hearing test and a comprehensive visual evaluation. 
The results of the afore mentioned examinations are included in 
each student's case record and serve to form a vital part of the 
students individual treatment pattern. A sampl> of these -records 
has been examined by the project evaluatqr. - . ' 

Objective 4 : . Parents of at least 50 percent of participating pupils will 
be involved in support of the center's efforts to remediate the reading 
difficulties' of their children. \^ 

Outcome 4 ; The objective was attained . Project records show that 
parents' were contacted on a continual basis, and were involved in 
both /the Implementation and continual sharing of information in the 
project. During the 1979-80 school year the Diagnostic Reading 
clinic notified parents of the date their child was to be diagnqsed, 
and invited them to attend the se^ipn. If parents were unavailable 
to attend the session, a second "meeting was arranged to accommodate 
the parents. .< 

' 5*. - -2 



The following statements axe representative of responses ^to parent question- • 
nairds. 1 * 

* My child would like toVcontinue /in the project even after 
1i£ is scheduled to le2ro v v 

. My- child has "^n improved attitude toward school. . 

. My child is esger now to read aloud in class she had always 
been nervous. * ' 

. Has increased self confidence. 

• . Objective 5 : At least 50 percent gf the classroom teachers^of pupils 
served by the project will receive consultative .services from the Clinic 
st&ff.- < ( 

. Outcome 5 : The objective was attained /- Questions number one and 
two of the teacher questionnaire illustrate that 62% of the teachers * 
visited the clinic on at least one occassion, while 100% of the 
responding teachers stated that they had been invited to visit the 
reading clinic. The questionnaire was submitted to the teacher of 
one randomly selected participating student in each of the 64 
schools. Thirty? seyen teacllers responded to the questionnaire. 



ADDITIONAL FINDINGS 



As can be seen by the replies to the questionnaire inquiries, teachers 
report positive patterns . regarding both reading interest and comprehension. 



i, w/i' 



SUMMARY AND CONCLUSIONS c 

The Diagnostic Reading Clinic proved to be a valuable program, which 
successfully aided students with reading difficulties. Efforts are presently 
under way to combine the resources of the project with other projects. 
These efforts should'be pursued and expanded in an attempt to serve as large 
a number of students as possible. Also a continuing method of communication 
with parents should be implemented. A newsletter or project info memorandum 
ould effectively meet this need* 
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APPENDIX A 

A 

« 

Composite 



DIAGNOSTIC CLINIC 
Teacher Opinionnarie 



DRC 1980 




4? 



has been receiving services of 



the Diagnostic Reading Clinic. We are interested in securing 
from you, his classroom teacher, ^ome^observat ions about his 
present reading •performance. Please return this completed 
form in the enclosed envelope to DIVISION OF RESEARCH, DEVELOP 
MEtfr AND EVALUATION no later than July 31, 1980. Thank you 
for your help. 



1. Were you invited^jo visit the clinic? 100% Yes £ No 

2. Did you visit/ the clinic this year? 62% Yes 3£ No 
/ / 

3. When was child assigned to receive help from the clinic? 

Since: 63% Oct. /Nov. 28% Dec. /Jan. 19% Feb. /Mar. April/May 

Other: 

— i 

4/ .What is gTeatesj^ reading problem for this child? 

68% stated comprehension . 



5. Child's final mark in reading for this year will be 



6. Child's days of absence for thistyear as of the date of this report 



CZZ3- 



7. Child's latest P.L.R. 



(Test 



9 
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APPENDIX A (Cont'd) 



8, Child's latest Comprehensive Test of Basic 

' Skills Reading score/ Iowa Test of Basic skills, 



Circle Test: Level 1, 2,13 



Vpcab * 



Compre, 



9. Child's Readiness Test score qr grade 
equivalej 



Gr. Eq v 


Gr, EqV 






Score G.E. 



12. 



Please check test: MetioiaJTitan 

10. In your opinion, -can thi^ child handl^-U^e usual reading material used 
in his grade? 

44% Always 

*~ 43 Most of the time 

6% Sometimes 

7% Rarely 
Not at all 

11. In general, have you noted any degree of improvement in: 



a. Pupil participation in group work 

b. Pupil written reading assignments 

c. Pupil confidence in his reading attack 

d. Pupil's general attitude toward sfchoo; 



Not ' 




Very 


Doesn 't 


At All 


Some 


Much 


Apply 


22% 


38% 


40% 






'39% 


22% 




71% 


10% 


19% 




63% 


20% 


17% 





What use does child make of free reading opportunities? y 
Over 70% of the respondents felt that roost students approached free 
reading time with increased enthusiasm. ' . 
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TITLE I -SCHOOLS SERVED 



PUBLIC SCHOOLS 
Elementary 



1979-80 
Diagnostic Reading 



1. 


Alfred A. Btenesch 


• 22. 


George W. Carver 


45. 


Miies 


2. 


A.J. Rickoff , 


23. 


Giddings 


44. 


Miles Park 


3. 


" Anthony Wayne 


24. 


Gilbert 


45. 


Miles Standish. 


4. 


Anton Grdina 


25. 


Harvey Rice 


46, 


Mt. Auburn 


5. 


Boul evard 


• 26. 


H.W. Longfellow . . 


47. 


Mt. Pleasant 


6. 


Captain Roth 


27. 


Hazeldell 


48. 


* Oliver H. Perry 


7. 


Case 


28. 


Hicks 


49, 


Orchard 


8. 


Charles Dickens 


29. 


Hodge* 


50. 


Paul L. Dunbar 


9. 


Charles H. Lake 


30. 


Rockefeller 


51. 


Paul Revere 4 


10. 


Charles Orr 


31. 


John W. Raper 


52. 


Robert Fulton 


11. 


, Charles .W. Chestnutt 


32. 


Joseph Landis 


53. 


Sacke^t 1 


12. 


Chesterfield 


33. 


Kenneth Clement 


54. 


Scrantdhv 


13. 


Corl ett 


34. 


Kentucky 


55. 


Sowinski ^ 


14. 


Daniel E. Morgan ' 


35. 


Lafayette <■ 


. 56. 


-Stephen Hdwe 


is. 


Dike 


36. 


Marion Seltzer 


57. 


Trefmont^^ 


16. 


Do an 


37. 


Longwood 


58. 


Unionl 


17. 


East Clark 


38. 


Louis Pasteur 


.59. 
60, 


Wade P^rk 


IS. 


East Madison 


39. 


Margaret A. Ireland 


Walton- 


19. 


Forest Hill Parkway 


40. 


Marion-Sterling 


61. 


Watterson-Lake 


20. 


GarfieldL - 

Wood land N Hills 


41, 


Mary B. Martin 


62. 


Wavefly 


21. 


42. 


Mary M. Bethune 


63. 
64. 


B uck ey e - Wood 1 and 
Bolton 



NON-PUBLIC SCHOOLS 



1. Mt. Pleasant Catholic 

2. St. Timothy 

3. - St. Thomas 

4. St. Vitus 

5. St. Michael 
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ENGIISH^AS-A-SECOND LANGUAGE PROJECT 

y » 

1979-80 Title I Evaluation * 



PURPOSE AND OVERVIEW 

' Tfyis project is designed to help second-language learners 
acquire an adequate level of proficiency in understanding, speaking 
and reading tfie English language, rapils served by* this project are 
provided, in a special classroom japart from their regular classrooms, • 
with extra classes' # in speaking and reading English, and acculturation \ 
activities. These special sessions, which average approximately forty- 
five minutes 'daily, are followed up with additional individual and 
sraall^group' remediation provided by teacher assistants.* A full-time 
social worker coordinates parent and community involvement in the pro- 
gram. 



SERVICE SUMMARY 4 <, V 



r ofo^^fl 



Number- ofr(Pu»fls Served: 664 Grades Served : PreJSifhool-6 



> ^ Number of Schools: 16 Years in Operation:- 13 



Staffing: 1 Project Manager, FT 
18 Teachers, FT 
IS Assistants, FT * 
1 Glerk, FT , 
1 Social Worker, FT 
^.Community Aide, *FT " • 



4 



Total Title I Expenditures: $S14,02l' Per Pupil Cost: $774^ 

objectives And outcome^, ^Sjl 

Process Objectives ■ / 

•V Objective 1: Assignment of an English-As-A-Second Language team, 
consisting of an ESL teacher and a teacher assistant,^© schools 
• will be based *on concentration of ^on-English speaking students. 

ft 

' . Outcome: Objective 1 was achieved. Sixteen schools and a - 
total of 664 students, participated in the 1979-80 ESt pro- 
gram. These schools w£re selected because of their high 
concentration of non-English speaking children. Fifteen of 
18 ESL classes had one teacher assistant assigned to assist 
the teacher with classroom instruction. These assistants 




1 



were assigned to those Schools "having the highest concentra- 
tion of. non-fcglish speaking children* Students in thaXpro- 
ject were representative of approximately 12 different langu- 
age groups ♦ 



Objective 2: Pupils will be grouped according to needs in oval 

English £nd reading skills. 4 " 

< 

\ Outcome : Objective 2 was achieved. All students tfere screened^ 
prior to * assignment . This screening involved the use of sep- 
arate, instruments for readiffg and speaking; On all instru- 
ments, students had to score at the 33rd percentile or below 
before accept into t the program. Screening instruments 
for sptakingVaMr reading classes, by grade level, are listed 
in Appendix A, Table 1. Jhe total enrollment for the speak- 
ing classes was-553 students, ..while, the total enrollment for 
reading, classes was S&^Students. * A total of 53 students were 
enrolled in both 'speaking and reading classes. The schools and 
number of students served can be found in Table 2 of Appendix A. 

Objective 3: Curriculum program will .carefully structured to 
include language structures and vocabulary that are readily, avail- 
able within the daily experiences of children and geared to the 
proficiency levels of participants. 

r Outcome: Objective 3 was achieved. Curriculum guidelines 
were developed by the rpraject for the speaking and reading > 
classes. The guidelines are based on locally developed and 
commercially available curriculum materials for^children in 
child development through grade six classes, fhildren served 
by the project progress to higher % levels of proficiency as 
measured by criterion-referenced tests. 

Objective 4: Parent involvement and participation in the learning 
experience of the children will be actively enlisted by project 

staff. " ^ 

\ < 

. Outcome :' Objective 4 was achieved. The Social—Worker- assigned 
to the project completed 2,091 home visits, initiated 126 comr 
munity contacts, held 108. conferences with printipals^narti- l 
cipated in '25 parent education meetings, -two ESL Parent N^dyisory 
Committee n*eetin£s and seven city-wide Parent Advisory Committee 
•meetings. In addition, ESL teachers were availably to parents 
on an individual, as -needed basis. 



Project Jtanagement cites Else Hamayan, Bilingual Education 
Service ISfcter (Midwest Region): Experience has shown that a 
student dKst leam to speak English at about the same level as 
an English-dominant six-year-old before s/he -can' read English. 
Hence, the ESL Program has as its treatment focus the develop- 
ment and upgrading of listening and speaking language skills. 
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. Qbjective 1.: Participants in reading classes will sKow improve- 
ment in the level of reading vocabulary (+7 or more JlQEJrunits) on ■ 
the mean pre-post scores obtained on the, reading vocabulary sub-. 

* test of the Comprehensive Tests of Basic Skills (grades one-six) . 

. Outcome: Objective 1 was achieved, at three out of six grade . 
levels. All tests were administered on a pre-post basis, with 
^the pre-tests being administered in November, -1979 and the pdst— 
test -administered in either April or May, 1980, in accordance 
with the city-wide testing schedule., The pre-post results, by 
grade level, can be found in Table 1 of Appendix B. 

These data indicate that for grades 1 and 5, the average N^E * 
gain was negative (-10.31 and -3.40 respectively). For grade 
4, although the gain was positive (6.00) it was below the 
stated criterion of +7 or more NCfe units. For grades 2, 3, and 
6, the NCE gain was above (+8.88, +7.42 and +7.33 NQE units 
respectively) the stated criterion. (Small sample sizes at ^ 
grades 4, 5 and 6 make tha representativeness of the results at 
these grade levels open to question) . 

* # 
Although the objective criterion standard was' stated in terms of 
NCE units, the following table will enable the reader to see the 
■ pupil standing represented by perceptile ranks, based on^national 
v norms and relative to students 1 of the same age. ^ 

PERCENTILE RANK 
Reading Vocabulary 



Gra&r> 


Pre test . 


Post test 


1 


43.5 


33.8 


2 


16.3 


28.8 


~*.3 


11.3 


18.5 


4 


39.7 


5l'.0 


. 5 


10.0 


7'.S 


" 6 


7.0 . 


13.0 



Again, the greatest impact appears at grades i, 3, and 6, 
Relatively little movement occurred at grade 4 and test per- 
formance' actually declined at grades \ and 5. (A pre-post 
difference near the middle of the percentile scale represents 
a much smaller difference in test performance than the same 
pre-post difference at the low or high ends of the percentile 
scale). It will be noted that post test percentiles are still 
relatively low on the percentile scale. 

*NCE (Normal Curve Equivalent) units are normalized, equal-interval, 
standard scores with a mean of 50 and a standard deviation of 
21.06, derived by dividing the distance from the mean' to the 99th 
percenti^le by the same distance measured in. terms of normal curve 
standard deviation units ( .3267). The resulting scale includes 
exactly 98% of the population which lies between the 1st and the 
99th percentile. 



Objective 2r Participants in reading classes wilj show improve- 
ment in the level of reading comprehension (+7 or more NCE units) -V 
6n the mean pre-pos^t.*scores obtained on the reading comprehension 
subtest of the Comprehensive Test of Basic Skills (grades one-sitf )• 

Outcomes ' Objective 2 wa^achieved at twp put of six grade 
levels. All* tests^were Administered on a pre-post ^asis, 
with the pre-tests administered in November, 1979 and the 
post-test administered in April or May, 1980 in accordance 
with the city-wide testing schedule. The pre-post results, by 
grade ley el, can be found in Table 1 of Appendix B. 

i 

These ctata indicate that for grade five, the average NCE gain 
was negative (-4.00) . For grades one, jthree, and six, although 

' the gain >was. t positive (+4.92, +5.42 and +1.33 respectively) it 
was below the stated criterion of +7 or more NCE units. Fo£ 
both grades two "and four, ..the NCE gain was above (+11.51 and* 
+10.75 units respectively) the stated criterion. (Small^sample 

9 sizes at grade 4, 5 and 6 make the representativeness of the re- * 
suits at thfcse grad£ levels open to question.) *^ 

Pupil standing in Reading Comprehension is presented in the folldw 
ing table by the use of percentile ranks. * 

PERCENTILE RANK 
Reading Comprehension 



/ 



Grade 


Pre tests 


Post test 


1 . 


24.7 


* 32.6 


2 • 


16.8 


33.4 


3 


12.4 


17.1 


4 


33.1 


59.9 


5 


,27.5 


21.6 


6 


17.1 


' 18.7 



Pre-post gain in grades 2 and 4 is once more documented using 
percentile ranks. It can -also be- seen,, using this percentile 
table, ,fhat grades 1, 3, and # 6 showed little movement pre-post 
and that grade 5 post test scores and percentile rank declined. 
(A pre-post difference near the middle of the' percentile scale 
represents a much smaller difference in test performance t^an 
the same pre-post difference at the ldjf or high ends of the per- 
centile scale.) It will be noted that post test percentiles are 
still relatively low on the percentile scale. 

* 

Objective 3: Participants in speaking classes at tfre pre-school 
and kindergarten levels will show significant improvement (p < .05) 
in listening comprehension skills on the mean V^Vost scofes ob- 
tained through the administration 'of- the Test of ^petitory ^Compre- 
hension of Language (TACL) . 
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jt corner Objective 3\was achieved. The Test for Auditorf* ~ 
Cqtoreftension of language (TACL) was administered to Child ' 
Itevildpment and Kindergarten students in ESI, speaking classes 
yd a pre-post basis in November, 1979 and in May, 1980. Using 
^t/test, there were statistically significant gains between 
pre and post test scores for. both, grade levels for.all three 
of the subtests (Vocabulary, Morphology, Syntax). r These gains 
far exceeded the objective criterion. Table 2 in Appendix B 
presents the results of this testing. * 



Objective 4: Participants in speafcijig classes in #rad£s qhq 
through' six will show significant improvement (p.^1,.05) in 
listening comprehension and oral production skills on the mean 
pre-post scores obtained through the administration of the Langu- 
— age Assessment Scale. 

« •% 

. Outcome : Objective 4 was achieved. Students in speaking 
classes in grades one through six were administered both the 
» listening comprehension and the oral productio\ subtests of 
the Language Assessment Scale (LAS) on a 'pre-post basis in 
November, 1979 and in May, 1980; Students in grades one 
through five were administered Level I of the LAS and grade 
six students were administered Level II of the LAS. The re- 
sults of this testing can be found iurfable 3 of Appendix B. 
These results indicate that for both the comprehension and 
oral production subtests of the LAS', the pre-post gains were 
significant at the .'001 level at all six grade levels. 

ADDITIONAL FINDINGS i 

As a part of the project activities, students from 16 ESL schools 
participated in 27- field trips. A list of field trips taken can be found 
in Appendix^ C. 

Every attempt was made to coordinate the ESL reading evaluation 
with the city-wide testing program and the bilingual program, thereby eli- 
minating dual testing of some students. This cooperation proved effective 
in the majority of schools, but there were some coordination problems in . 
. specific schools. 



^1 



SUMdARY A^), CONCLUSIONS: 

The 1979-80 English-As-A-Secdnd Language Project was successfully \ 
implemented according to guidelines contained in the process objectives. 
The project achieved two of its product^bjectives at all grade levels. 
The other two product objectives were achieved at some grade levels,* The 
following are recommendations for the 1980-81 year: 

- • Parent activities have proven their merit and should be continued. 

. Cooperation between ESL, bilijigual, and city-wide testing programs 
should continue with concentrated effort in specific schools to 
eliminate problems in coordination. 

' . Prtfjefct administration Should* identify the reasons why reading*' gains 
in both vocabulary and comprehension are below 'the stated criterion 
atr several grade levels and- should take any programmatic action nec- 
cessary to eliminate or reduce the difference between stated criteria 
and actual attainment levels. ' % 



*It should be noted that the sample sizes used in computing the 
NCE gains in Reading for grades 4-6 were quite small. Consequently, 
the regpesentativeness of the results is open to question. 

\ 
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APPENDIX A 
TABLE 1 
SCREENING TESTS 
READING CLASSES 



Screening Test 



Grade* 



Screening. Test 



Grade 



For . students previously in 
Cleveland System: 
Metropolitan Readiness Test, 
Kindergarten administration 
(Spring, 1980) 

For students qfcw to Cleveland 
System : 

ESL teacher administered 
Metropolitan Readiness Test, 
1980 .. 

For students previously in 
Cleveland System: 
CTBS, Level B, Form S first 
grade (Spring, 1980) adminis- 
tration, appropriate score 
one one of the following sub- 
tests: Word Recognition I; 
Comprehension; Word Recogni- 
tion II 

For. students new to Cleveland 
System: 



ESL teacher administered 
California Achievement Test, 
Level II, Fornix A Reading 
Comprehension or Reading 
Vocabulary subtests 



For students previously 'in - 
Cleveland System: 
CTBS, Le^eKC* Form S, 2nd 
grade administration (Spring., 
1980) Reading Vocabulary or 
Reading Comprehension: 
Passages subtfest 

For students new to Cleveland 
System: \ 
ESL teacher administered 
^California Xcfiievement Test, 
Level II, Form A Reading 
Comprehension or Reading 
Vocabulary subtests (Fall, 
1980) 

Stanford Diagnostic Rfc^ding 
Test 2, Reading Comprehension 
subtests, Green Level, Fall 
lp80. Administration through 
city-wide testing 

or t , . 
ESL teacher administered 
California Achievement Test, 
Level II, Form A Reading 
Vocabulary or Reading Com- 
prehension subtests (Fall, 
1980) 



APPENDIX A (Cont'd) 
• TABLE I 
SCREENING TEST 
READING CLASSES 



Screening Test 



Grade 



Screening Test 



Grade 



Stanford Diagnostic Readings 
Test 2, Reading Comprehension 
subtest; Brown Level, 'Fall, 
1980, Administration through 
city-wide testing 
or 

CTBS/ Level II, Form S, 4th 
grade administration (Spring, 
1980) Reading Vocabulary or 
Reading Comprehension subtest 



Stanford Diagi&stic Reading 
Test 2, Reading Comprehension 
subtest, Brown level, Fall, 
1980. Administration through 
city-wide testing program 

or m . , * 
*ESL teacher administered 
Calif orftta Achievement Test* 
Level 3, Form A, Reading 
Vocabulary or Reading Compre- 
hension, Fall 1980 
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APPENDIX A (Cont^d) 
TABLE I 

NING TESTS 
SPEAKING CLASSES • 



Screening Test , Grade 

Screening Test for Auditory CD 
Comprehension of Language 
(STACL) Fall, 1980 Adminis^ K 
juration 

SPLIT TEST (Schutt: m , 1 

University of Arizona) 
Verbal Fluency-English 2 
§ubtest, Fall, 19BO- Adminis- . ^ - . 
t rat ion 1 % 4 

Fall, 1980 Administration of 1' 3-6 
Language Assessment Battery 
English Level II, Grades 3-6 
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APPENDIX A - 
Table, 2 
Schools and Students Served 

i&7a-8a 



( • 



Schools Served 
1 



Public 

Buhrer 

Case • 

East Madison 

Kentucky 

Orchard 

Paul Dunbar 

Sadkett 

Scranton 

Tremont 

Walton 

Watt erson- Lake 
WaVerly 



Non-Public 

Immaculate Conception 
St. Francis 
St. Michael 
St. Vitus 



Count of Pupils by G^ade Level 



Grade 

Child Development 

Kindergarten 

Grade 1 'M' 

Grade 2 

Grade 3 

Grade 4 

Grade 5 

Grade 6 

Grade 7 

Grade 8 



No. of 
Students 




fa 



9 
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APPENDIX B 
Technical Tables 
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APPENDIX B 



TABLE 1 



Vocabulary and Comprehension Subtests 
Mean NCE Gains by Grade 



3rade 



1 
2 
3 
4 
5 
6 



N 



13 
16 
12 
4 
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Vocabulary 



NCE 



Pre test X 



Post test X 



46.62 
29.31 
-24.50 
44.50 
23.00 
19.00 



Total X 
NCE Gain 



41.24 
38.19 
31.92 
50.50 
19.60 
26.33 



X Gain 



-5.38 
+8.88 
+7.42 
+6.00 
-3.40 
/ +7.33 



-1* 



Comprehens-ion 



Pre test X 



+3.59 



35.62 
29.69 
25.66 
40.75 
37.40 
30.00 



NCE 



Post" test X 



X Gain 



40.54 
41.00 
31.08 
51.50 
■ 33.40 
31.33 



4.92 
+11.31 
+ 5.42 
■$10. 75 
4.00 
+ 1.33 



+ 6.36 



U 



* APPENDIX B. (cont'd) 



TABLE 2 - 
Summary of Pre-Post Testing 
-TACL, Child Development and Kindergarten 



Child Development 



Vocabulary 



. Morphology 



Syntax 



N . 
Pre Test x . 
,J>ost Test X 
S.D. Pre 
S.D. Post 
' t \ 
X prejpost gain 
S.D. fJre-post gain 



Kindergarten 



N 

Pre Test X^ 

Post Test X 

S.D. Pre 

S.D. Post 
t 

X pre-post gain 
S.D. pre-post gain 



26 

1 13.23 
32.23 
10.37. 
3.42 
8.430* 
19.00 
11.49 
*p< .001 



*P 



93 
23.54 
33.69 
9.69 
3.93 
.9.786* . 
10.15 
10.05 
C .001 ' 



. 26 

13.58 
32.08 ' 
10.52 
'4.93 
7.869* 
18.50 
." 11.99 



93 
20.78 
34.16" 
* 9.02 
5.96 
14.044* 
13.38 
9.19 



26 
2.73 
6.69 
2.22 
1.76 
7.055* 
3.96 
2.86 



93 
4.53 
7.22 - 
2.41 
1.71 
10.434* 
2.69 
2.48 . 



V 

* \ . TA3L0 3 

Summary of Pre-Post Testing 
Language Assessment Scale, Grades 1-6 




Gr ad^e 



Subtest 



Pxd Test X 
Poit Test % / 
s/d. Pre 
S.D. Post 

X Pre-Post Gain 

S.O. Pre-pfip 
Gain 



Comp . 



3. & 
6.58 
2.35 
1.91 

10.116* 
2.64 

2/09 



Oral 
Prod. 



63 

1.22 
2.43 
0.96^ 

jar 

0.89 

11.874* 
1.21 

0.81 



Comp. 



29 

4.76 
7.10 
2.20 
1.72 

6^98* 
2.34 

2.00 



Oral 
Prod. 



29 
1.55 
2.69 
1.06 
0.89 



Comp . 



d 9 

"1 



5.975* 
1.14 

1.03 



29 

17, 
63 
1.91 



8.912* 
^"2?9>- 



1.77 



Oral 
Prod. 



29 
1.24 
2.72 
1.09 
0.96, 

9.168* 
1.48 

0.87 



Comp . 



r 

28 * 
4.21 
7.29 
3.12 
2.05 



6.297* 
3.07 

2.58 



Oral 
Prod. 



28 
1.61 
3.07 
1.40 
1.15 

7.481* 
1.46 

1.04 



Comp . 



34* 

4.56 . 
7.65 
2.85 
1.63 

7.738* 
3.j)9 

2.33 



Oral 
Prod. 



34 

1.74 
?.88 
1.46 
1.07 

5.315* 
1.15 

1.26 



Comp. 



36 
4.81 
8.42 
3.09 
1.55 

6.050* 

3?62 

3.05 



Oral 
Prod. 



26 

1.50 
2.73 
1.14 
1.00 

7.272* 
1.23 

0.86 



p<..001. 
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APPENDIX C 

ESL Field Trips 
1979-80 



Zoo 

Aquarium 



\ 



Western Reserve Historical 
Society Museum 

Natural History Museum 

NASA 

Police Department 
Police Stables 
Justj.ee Center 
FBI Office 
Hale Farm 
Greenhouse 
City Tour - 
Trail side Museum 
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MATHEMATICS SKILLS IMPROVEMENT PROJECT 



1979-80 ESEA TITLE I 



PURPOSE AND OVERVIEW , 

The MSIP was developed to provide intensive mathematics instruction 
to small groups of low.-achieving students in selected Title I schools. The 
purpose was to assist students to develop appropriate and necessary skills 
which would allow the achievement of adequate progress in and completion of 
the prescribed school program. This remedial instruction is conducted out- 
side of the regular classroom by trained Math Specialists,* and is in addition 
to regular math instruction. Integral, aspects of £he program include the 
following, 

. Workshops and in-service training for Title I teachers. 

. The instruction and reinforcement of parental mathematics 
instruction at home. 

, Demonstrations in the mathematics laboratory for classroom 
■ teachers * ~ * 

. The publication and distribution of newsletter to all 
affiliated with the project.' < ) 

SERVICE SUMMARYT "~ 

Number of fojpils Served : 2,437 Grades Served : 3, 4, 5, 6, 7, 8* 

^/ % ' , *Non -public schools 

Number of Schools Served : 51 public 
--*hp* 9 non-public^ Years in Operation : 12k 

(List in Appendix A) - 60 total , 

* . 
Staffing: 54 F.T. Teachers 
' 1 F.T. Secretary 
^ 1 F.T. Supervisor 

56 Total ,F.T. Personnel - 

Total Title I Expenditures : $1,301,988 Per Pupil Cost : $534 
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OBJECTIVE AND OUTCOMES 

Process Object ive 1: Each full time consultant will provfde an 
verage daily enrollment of 48 mathematics underachievers from 
ades 3, 4, 5, 6, with remedial -instruction in mathematics skills, 
enrollment variance of no more than seven percent (7%) will be 
acceptable. \ 

Process Objective 1 was achieved . An average daily 
enrollment of 50.39 mathematics underachievers were served by 
each consultant teacher this year/ This compares with an . 
average enrollment of 47.7 students served the previous year\ 
Of the 54 consultants participating in the project, all provided 
the opportunity for the appropriate number of studeftts to be 
served, thus meeting the objective. However, attendance records 
indicate that nearly half of the consultants did not service 
the correct number o£ students, because of low student attendance. 

Process Objective 2 : Bach part-time MSIP consultant will provide an 
average daily enrollment of 20 mathematics underachievers from ' 
grades 3, 4, 5, 6, with remedial instruction in mathematics skills. 
An enrollment variance of no more than seven percent (7%) will be 
acceptable. 

. Outcome 2 : Process Objective 2 was achieved . -The average daily 
enrollment was 19.5 for students in grades three through six 
who received remedial instruction in mathematics skills. This 
compares with an average of twenty two students served the 
previous year.' 

Process Objective 3 : MSIP consultants will provide for each reme- 
dial mathematics student one 40 minute period of small group in- 
struction for at least 90% of the days that school is in session 
each semester. 



Outcome 3 : Process Objective 3 was not achieved . As shown in 
Appendix B a wide range in the number of MSIP instructional days 
occurred during the past year. These variations can be observed 
in both the fjrst and second semesters. The acceptable 90% 
minimum for the first semester number of days was 87.3 instruct/ 
ional days. Not one o£ the 51 schools achieved this minimum re- 
quirement. The acceptable 90% minimum number of /instructional 
days for the second semester was 81 instructional" days. Ninety 
two percent of the 51 schools met this requirement. / 



Process Objective 4 : When surveyed 75% of the parents ,df MSIP 
students will be able to acknowledge being contacted . %y the Mathe- 
mtics Skills Improvement Project. 



ERLC 



Outcome 4 : Process Objective 4 was achieved ." The following 
information was obtained through the distribution in May of 1980 
of questionnaires to parents. Questionnaires were \given to 600 
parents with 517 being returned. One hundred percent of thfc 
parents reported that they did havj£ knowledge of the MSIP project. 
Ninety one percent stated that^ttrey had received information 
concerning the project, and 51% reported that they had visited 
their child's classroom. (See Appendix C for parent survey results.) 
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. Product Objective 1 : The MSIP observed group mean posttest perfor- 
mance will be at least five NCE* units above the expected group mean 
sco^e which Has been estimated by. regression analysis of Spring, 
1979 and Spring, 1980. CTBS 'Mathematics Test -scores. Analysis will 
be by grade levels ti^ree, four, five, six, seven, and eight. 

. Outcome : Regression Analysis For 1979-80 . The regression analy- 
sis was performed Using the^otal, mathematics scores obtained 
from the Spring, 1979 and Spring, 1*980 City-Wide administration 
of the CTBS. The predicted post test mean represents the level 
of achievement the served group would have compiled had they 
remained in the regular classroom with the comparison group. 
The observed post test mean is v[hat> was actually observed for 
this groupi following inclusion and participation in the project. 
The difference between these two means indicates the gain made 
by the serv^^P 7011 ? beyond what they could have achieved with- 
out, the services of the project. The pre and post scores for 
, the MSIP and comparison groups are presented in Appendix D. 
Results of the statistical analysis of the difference between 
observed and expected scores appear inAppendix E. A summary 
of the results by grade level is as fallows: 

Grade 3 Outcome 

Test results were analyzed 'for 292 students from grade 3. Regression 
& analysis yielded a predicted post score mean of 37.13 NCE units as 
compared to an observed post score mean of 37.50 NCE units. This 
gave a treatment effect of .37 which is less than the 5 NCE units set # 
by the objective. While this figure (.37) is^statisf ically not 
significant it illustrates that the product objective for this grade 
has no.t been achieved. A summary of the regression analysis for' 
grade 3 appears in Appendix F. f 

/ 

Grade 4 Outcome 

Test results were analyzed for 482 students from grade 4. Regression 
analysis yielded a predicted post score of 32.15 NCE units as compared 
to an observed post score mean of 36.29 NCE units, this gave a treat- 
ment effect of 4.14 NCE "units which was statistically significant 
(p < .01). However, siqce a positive difference of 5 NCE units bet- 

" w"een the predicted ^SQore and the observed score was not obtained, the 
product objective for this grade has not been achieved. A summary of 
the regression analysis for grade 4 appears in Appendix G. 

* ■ . 
Grade 5 Outcome » • 

Test results w^re* analyzed for 403 student* from grade 5. Regression 

. analysis yielded a predicted post score mean of 25.56 NCE units as 
compared to an observed pq|t . score mean of 34,04 NCE unj£s\ 

*NCE (Normal *Qprve& Equivalent) units kxe normalized 1 equal interval stan- 
dard scores with a mean of and a standard deviation of 21.06, derived* 
by dividing^the distance from the -mean to the 99th percentile by the 
same distance 'measured in terms of normal curve standard deviation units 
(2.3267). Tlfe resulting scale' includes exactly* 98% of the population 
which .lies betwebn the 1st and the 99th percentile. 
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*This gave a treatment effect of 8.68 1 NCE units which was statistically 
significant (p. < .01). Since, the difference between the observe and 
predicted score exceeded 5 NCE units, the product objective for this 
grade has been achieved. A summary of the regresstion analysis for 
grade 5 appears in Appendix H. 

Grade 6 Outcome 

Test results were analyzed for 363 students from grade 6. Regression 
analysis yielded a predicted post score mean of 29.56 NCE units as 
compared to an observed post score mean of 37.41 NCE units. This gave 
a treatment effect of 7.85 which was statistically significant (p. < .01) 
The product objective For this grade has been achieved. A sbmmary of 
the regresstion analysis for grade 6 appears in Appendix I. 

Although the product objective states the unit of measurement to be the N.C.E., 
the following table will show pupil standing byv^ercentile ranks based'on 
National Norms. 



\ 



PERCENTILE RANKS 



OF TOTAL MATHEMATICS SCORES 





jGrade 


PreSTest 


Post-Test 


CTBS Level 1 
Form S 


•3 


12.7 


• 27.7 H 


CTBS Level 2 
Form S 


4 


15.9 


25.8 


CTBS Level 2 
Fonfi T 


5 


12.1 


22.4 


CTBS Level 2 
form S 


6 


44.1 


27.5 



As illustrated by the chart shown above, the scores of most children 
improved following their participation in the Math Skills project 
of 1979-80. However, performance levels remained in the lower third 
of students nationally: £ - % * 
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ADDITIONAL FINDINGS 

. The process of test distribution was somewhat chaotic, improvements in 
the procedure have already been undertaken. ) 



SUMMARY AND CONCLUSIONS 



As the regression analysis has illustrated the product objective was 
achieved for grades 5 and 6? Grade 4 fell slightly below the criteria 
level. Grade 3 however fell far short of meeting the objective. An 
attempt should be made to discover the reasons behind the poor showing 
of the third grade. Also of interest is the fact that the results of 
the 1978-78 regression analysis yielded, similar low results for the 
third grade. / 
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APPENDIX A 
1979-80 MSIP SCHOOLS SERVED 

PUBLIC SCHOOLS 



1. 

2. 


Alfred A. Benesch 
Anton Grdina 


/' 


27. 
28. 


John W. Raper 
Joseph F. Landis 


3. 


Anthoriy Wayne 




29/ 


Lafayett e 


4. 


i 

Bolton ' 




30. 


Longinead 


5. 


Bouleyard 




31., 


Longwood f 


6. 


Captain A. Roth 


t 


32. 


Louis Pasteur 


7. 


Case (a.m,) 




33. 


Margaret Ireland 


8.- 


Charles Chesnutt 




* 34. 


Marion-Sterling 


9. 
10. 


Charles Dickens 
Charles H. Lake 




35. 
. 36. 


Mary B. Martin 
Mary M. Bethune 


llT 


Charles Orr (a.m.) 




37. 


Miles Stan^ish 


12. 


Chesterfield 




38. 


Mount Pleasant 


13. 


Daniel E. Morgan 




. 39. 


Orchard^ / 


14. . 


Dike 




40. 


Paul Dunbar 


15. 


Do an 




41. 


Paul Revere • 


1<2. 


East Clark 




42. 


Robert Fulton 


17. 


East Madison 




43. 


Scranton 


18. 


George W. Carver 




44. 


Sowinski 


19. 


Gi'ddings (p.m.) 




45. 


Stephen E. Howe 


20. 


Gordon (p.m.) 




46. 


Tremont 




Harvey Rice 




47, 


Wade Park 


22. 


Hazeldell 




48. 


Walton (a.m.) 


23". 


Henry j?. Longfellow 




49. 


Watterson-Lake 


24. 


Hodge 




j50. 


Waverly 


25. 


Hicks (p.m.). 




51. 


Woodland Hills 


26. 


John D. Rockefeller 
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APPENDIX A (Cont'd) 



NON- PUBLIC SCHOOLS 

1. St. Aloysius 

2. St. Catherine (a.m.) * 

3. Nativity B.V.M. (p.m.) 

4. Mt. Pleasant Catholic 

5. St. Paul Croat ion (p.m,) ^/ 

6. S& Benedict (a\m.) 

7. St. Thomas Aquinas (a.m.) 

8. Holy Rosary (p.m.) 

9. ' Our Lady of Peace (p.m.) 
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APPENDIX B 

) 

* Number of First Semester Sessions 
Held by the' MSIP 





School 


had 


j 30 


First 


Semester 


Days 


One 


School 


had 


32 


First 


Semester 


Days 


One 


School ' 


' had 


(37 


First 


Semester ■ 


Days 


One 


School 


had 


40 


First 


Semester 


Days 


One 


School 


had 


42 


First 


- Semester 


Days 


Two 


'Schools 


had 


46 


First 


Semester 


Days 


One 


^'School y 


had 


48 


. First 


Semester 


Days_ 


One 


^School 


had 


• SS 


First 


Semester 


Days . 


Four 


Schools 


had 


56 


First 


Semester 


Days 


One 


School 


had 


66 


First 


Semester 


Days 


The 41 other Schools had 
were held. 


55 first 


semester days, during which math classes 




.r 


m 

Number of Second 


Semester Sessions 




M 






Held by the MSIP 








School 


had 


60 


Second 


Semester 


Days 


One 


School 


had 


« 

63 


Second 


Semester 


Days 


One* 


School 


had 


68 


Second 


Semester 


Days 


One 


School 


had 


• 77 


Second 


Semester 


Days 


One 


School 


had 


87 


Second 


Semester. ; 


Days - 


two 


Schools 


had 


89 


Secohd 


Semester 


Days 


One 


School 


had 


92 


Second 


Semester 


Days 


The 
were 


43 other schools 
held. 


had 88 


second semester days, 


during which math 


classes 
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APPENDIX* C 



RESPONSE SUMMARY: 
PAflEffT SURVEY 
CLEVELAND PUBLIC SCHOOLS 




ematics Skills Improvement Project 
1979-80 



Dear Parent: ~ 

He are pleased that your child was part of a group who ^ere 
given special instruction in Mathematics. We now wish to know how you 
feel about this special help. Pleasertelp us by circling your answers 
to the questions below. 

. ( ■ 



ITEM PER CENT RESPONDING 
\ • 



1. Did you know that your child was YES NO 

receiving special instruction in Q ^ 
mathematics? 100% 



Did you receive aJty written in- YES 
formation about this special mathe- 
matics instruction? 9% 



NO 

i 



NO 



Did your child bring home to show YES 
,you any arithmetic paper or other 

objects from his arithmetic. 83% jkl 

teacher?* I f ^ 



Have you visited your child*s YES ^NO 

special mathematics class? , 51% 49% 

Did your child talk to you . MORE SAME , LESS 

more about his arithmetic ; 

class this semester than 52% 41% 7% 
before? 

Do you feel your child im- MORE SAME ^ LESS 

proved in arithmetic more * 

this semester than before? 82% i2% 8% 



Please have yoUr child return this questionnaire to his 
special matffteacher on the next school day. 

Thank you very ,fauch. 

May, 1980 

1 • - 79 £0 



APPENDIX D 

'Pre! and Posttest b CTBS Mathematics (NCE) Scores and 
Correlations for the Served and Comparison Groups in 
Grades 3^ 4, 5, and 6 
1979-1980 



Served 'Group (NCE-^ 42) Comparison Group (N CE > 42) 

Grade N Pre X Post X Change '"Corr. N Pre X Post X Change prr . 



3 


292 


26.01 


37 


.50 


11.48 


..52 


2921 


*§S.10 


66.15 


'11.06 


.59 
























.53 


4 


482 


29.00 


36 


.29' 


7.28 , 


.31 , - 


3401 


5€.45 


55.84 


.39 


5 


403 

¥ 


25.41 




.04 


8.63 


.29 


3386 


59/l8 


55.51 


-3.67 


.56 


6 


363 


27.31 


37 


.41 


10.10 


(. 44 


3333 


56.39 


55.50 


- .86 


.64 
























i , _ 












— \ — 













a For grades- 4, 5, and 6* CTBS Mathematics Test April, 1979, for- grade 3;. CTBS 
Mathematics November, 1979 • - 

b CTBS Mathematics Test Mareh^Rril, 1980 
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APPENDIX E 



Results of Model C (Regression)' -Analysis, for / 
. Grades 3, 4, 5^and.6 m 





- Grade 


t ~ 

Predicted^ 
Posttest X 


*0 

Observed _ 
Posttest a 


Effect 
or rxogxcun 






s 


' 3 


' 37,13 


37 .,50*' . 


.37 


.'54 n 


\ 




4 , 


•32 . IS 


36.29' 


4.14 ' 


2.35* 




• **" 


- 5 . 


25 . 36 


34.04 


8.68 


4.52*' ' % 




* 


6 ■ . 


. . 29.56 


37.41 


. 7.85 


4.92^ 


• 


















* *P<.0-1 




♦ 






• 






* 




\ 


• 






* 




v * * 




tr i 
• 






** * 
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APPENDIX F 

Summary of Regression Analysis for Grade 5 



Number of pupils M 

Mean of pretest scores 

& 

SJ). of pretest scores 

Observed mean of posttest scores 

SJD, qf^po^ttest, scores 

Correlation of posttest with 
pretest^ scores 

Slope of regression line for p^e- 
- dieting posttest from pretes^ scores 

Estimation (Prediction) equation 



Starfdard error^Bf estimate 
Test— index of estimation 
Significance of the estimation 



V 

Estimated mean of posttest score 

Effect of program service 

Test index of" treatment effect 

Statistical significance* of 
treatment effect 

Comments (if any): 



'SERVED 
GROUP 
(NCE <_'42) 

292 

26.01 

9.90 . 

37.50 • 

14.92 

.52 

.79 

i 



THE COMPARISON 
GROUP 
(NCE > 42) 



J 



2921 
55.10 
8.41 
66.15 
14.31 
.59. 



Estimated Posttest score =11.20 + 
.997 x pretest score 

^ « '12.75' - 11.61 

F (l, 2919) = 1524 4 22 

p< .01 

37.13 

37.50 - 37.13 = .37 
1(3210) = -5 4 
not significant. 
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APPENDIX G 

Supnary of Regression Analysis for Grade 4 

THE SERVED 

GROUP 
CNCE < 42) 



Number of pupils • f 

Mean of pretest scores 

S^^lf .pretest/ scores 

Observed mean of posttest .scores 
« 

S.D . of posttest scores 

Correlation of posttest with 
pretest scores 

Slope of regression line for pre- 
-dicting -posttest for pretest • scores- 
is timat ion (Prediction) equation . 

Standard error of estimate 



482 f 
29.00 
9.29 
36.29 
14.42 
.31. 

.49 



THE COMPARISON 
GROUP 
fftCE > 42) 

3401 

55.45 

8.7&, 

55.84 

14.91 

.53 

.90 



Test index of estimation 
Significance of the estimation 
Estimated mean of posttest score 

Effect of program service 

^ V 
Test index of treatment effect 

Statistical significance of 
treatmen^. effect 

Comments (if any^ : 



Estimated Posttest score = 6.17 + 
.896 x pretest score 

13.70 12.66 
" , "Hi, 3399) =.1312.61 
R < .01 . ' 
32.15 

36.29 -' 32.15 = T. 14 
1(3880) = ?- 35 




£< .01 
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APPENDIX H 

Summary of "Regression Analysis for Grade S 

THE SERVED 

GROUP 
(NCE£42) • 



Number of pupils 

Mean of pretest scores 

S*D. of pretest scores 

Observed mean of posttest scores 

S.D. of post^st scores • ; ^ 

Correlation of ppsttest with 
pretest scores 

\ 

Slope of regression line for pre- 
dicting posttest from pretest scores 

Estimation (Prediction) equation 
Standard^ error of estimate 

Test index of estimation 

f 

Significance of the estimation 
Estimated mean of posttest score^ 
Effect of program service 4 
Test index of treatment effect 



Statistical significance of* 
treatment effect 

Comments (if any) : 



7 



403 
25.41 
10.60 
34.. 04 
14.94 
.29 

.40 



THE COMPARISON 
GROUP * 
(NCE>42) 

3386 

/ 59.18 , 

9.20 

55.51 

14.58 

.56 

.89 



Estimated Posttest score = 2.67 + 
.89 x pretest score 

• 

.14.33 12.03 



hi, 3384) = \* 5 7*- 06 




p< .01 
25.36 

34.04 - 25.36 = 8.68 



-(37«6V 
p < .01 



= 4.52 
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APPENDlTf 

Summary of Regression Analysis for Grade 6 

THE SERVED- 

GROUP 
(NCTi 42) 



Number of pupils 

Mean of pretest scores 

S»D. of pretest scores 

Observed mean of posttest Scores 

S,D> <^f posttest scores 

Correlation of postt.est with 
pretest scores ^ v , 

Slope of regression line fo3>pre- 
dicting posttest from pretestv scores 

Estimation (Prediction) equation 
' Standard error of estimate 
Test index of estimation-* 
Significance of the estimation 

Estimated mean of posttest score ' 

\ 

Effect of program service 
'lest index of treatment effect 

/ • * 

Statistical significance of 
treatment effect 



THE C0M$ 
r GROl 

(NCE>\42) 



«■» 363 

27.31 
: 9 .'92 
37.41- 
*. 11.00 
.44 

.49 




-.89. 



Estiir ed Posttest* score = 5.20 + 
.892 x pretest sco^f. 

9.86 'jjdf' 
F (l, 3331) * 234 v 3 ' 95 

V, 

P < .oi- 

- 29.56 

37.41 - 29.56 = 7.85 

, ^(3693) = 4,S2 . 
' p < .01 



Comments (if any) 



P * 
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PROJECT REACH 



1979-80 Title I Evaluation 



Purpose and overview 

Project Teach, one of four components of the Reading^Tnstruc- 
tion Project, is a supportive program in grades one through four operat- 
ing at eleven public elementary schools and one non-public elementary 
sch<?ol. [The project stresses customized reading instruction through 
the use of differentiated^leaming materials and provides program con- 
sultant teachers*.with information about various reading instruction 
approaches and training in their use. A "facet of the project -receiving" 
special attention is the attempt to increase the awareness and irrvol^e^ — s 
ment of parents in the support of their children's reading progress. 
The program is administered by an Assistant Project Manager wKo works^T 
under the direction of the Manager of the parent program. Parricular. 
responsibilities of this administrator include inservice training of 
"'rradinj* consultant and teacher assistants (regular sessions), curricu- 
lum development, and the parent education program. 

~SERVICE~SUMMARY \ . ~~ 



Number of Pupils Served : 914 

Numker of Schools : 11 public 

1 non-putelic 
12 total 



Grades Served: 1-4 



Years in Operation: 9 



' Staffing : 1 Project • Administrator, FT 
12 Consultant Teacher?, FT 
_ 9 TeacheT Aides, FT 

Total Title I Expenditures: $432,717 * Per .Pupil .Cost : $473.43 



OBJECTIVES AND OUTCOMES Y 

. Objective 1 : The mean poSttreatment scores of participants - 
in grades two through four receiving eighteen weeks oi^more 
of service will be at least four NCE units* higher "than the 
mean pretest score. 

* Outcome f Objective 1 has been attained. Form A (Pre) and 
Form B* (Post) of the Comprehension Subtest' of the Stanford 
Diagnostic Reading Tests were administereS to pupil partici- 
pants to measure the effect of the project on the student^ 
Red Level tests were administered to -373, second and third* 



*NCE (Normal Curve Equivalent) units are normalized, equal- interval, 
standard so&reTTTtth a mean of 50. and a standard deviation of 21.06, 
derived by dividing the distance from tfie niean to the 99th percentile 
t>y* the same distance, measured in terms of normal curve standard devia- 
tion units (2.3267). The resulting scale includes exactly 98% of the' 
population which lies betvffe'en thellst.and the 99th percentiles. The 
u$e of the NCE units in reporting evaluation results is required by 
Title I guidelines. 4 t . * 
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grade pupils; Green Level tests were given to 90 fourtfi 
grade pupils. Table! , listing the data in terms both 
NCE units and percentiles > presents the findings by grade- 
level groups. Mean* rank of the pupil pa^ficipants at entry 
into the program was at the 13th percentile; after treatment 
the average rank of 'the students was at the 47th percentile. 
.The average gain for all f three grades was 22.0 NCE units. 
The Grade 2 group posted the greatest gain , nearly twice 
the gain of the third and fourth grade groups combined. 



Table 1 

Mean Group Gains of * * 

Second, Third, and Fourth Grade 
Participants of Project Reach stated in Normal Curve Equivalents 
(Stanford Diagnostic Reading Testes, Comprehension Subtest) 

N = 463 



^Grail 


N 


Pre test 


Post Test 


> .. - 
Mean ^in 


NCE 


%ile 


NCE 


• %ile 


NCE / 


\| 

4 


192 
181 
^90 


25.36 
29.50 
-25.28 


12.1 
16.5 
12.0 


55. 76 
46.97 
• 43.44 


60.7 
* 44.3 
37.7 


30.40 
17.47 
18.12 


Summary 


'465 


•26.71 


13.4 


48.72 


47.5 


22.00 



r 



Besides the Stanford Diagnostic Reading Tests, 
the Gates-MacGinitie Vocabulary and Comprehension Tests, 
Forms A, B^C, and D, were administered * pre and. posttreat- 
ment to project participants in Grades 1,2 , 3, and 4 f Res- 
pectively, as a supplementary measure of Objective L The 
findings are presented in Table 2, p 5. 

< 

* 

. 'Gains of at least 7 NCE units were posted in all 
vocabulary and comprehension subtests for all four 
grades except the Grade 4 vocabulary subtest (NCE Gain 
-K82). The loss brought the average, vocabulary gain 
for all four -grades down to 5s 8 NCE units. 

. m The average NCE gain in the Gates MacGinitie Compre- 
* hension Subtest (11.56' NCE's) exceeds the, Objective 1 
criterion of 4 NCE's'but it is well below the average 
NCE gain obtained in thf Stanford Diagnostic" heading 
Test. 
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It should be*7ioted that the tests measure two different 
functions: While the Gates-MacGinitie measures a global 
transfer of reading skills, the Stanford measures, specific 
skills transfer. Comparison of NCE gains between the two 
tests may not be warranted; theW\fb tests can be expect- 
ed to show different NCE gains. 



Objective 2 : Teachers will report observable improvement in 
the reading performance of at least 70 per cent of the pupils. 

. (Xitcome : Objective 2 has been attained. Sixty-eight 
pupils were randomly selected from the population of 
463 second, third, and fourth grade pupils who were 
given pre and post treatment tests. Pupil progress 
• , rating sheets which listed 35 skill -areas were sent 
to their teachers who were asked to rate observed 
pupil progress in the applicable skill areas as 
Vety Marked, Marked, Adequate, Limited, or Poor, 
•the 46 teachers who responded reported three oer cent 

of- improved skill areas by degrees of improvement fpr 

46 pupils: . " - 



Total 


Very Marked 


• Marked 


Adequate 


Limited 


Poor 


100% 


14.2%-. 


29.6% * 


35.6% 


16.9% 


3.7% 



In nearly four of every five identified skill areas 
according to the teachers, pupils demonstrated Very Marked, 
Marked, or Adequate progress. v In the remaining one-fifth 
(20,6%) of the skill areas, pupils ^demonstrated Limited or 
Poor progress. Appendix A, p. 8 presents a listing of the 
skill areas surveyed and the per cent and degree of improve- 
ment obStrved by the 46 responding teachers for 46 pupil 
participants. ' „ 

Objective 3 : Parents of participants will report observed 
evidence of improvement in readitig in their child. 

Outcome : J Objective 3 has been attained. Questionnaires 
were sent to the parents of the. same 68 randomly selected 
pupils. The fifteen parents who responded (22%) reported ob- 
serving a total of 21 pretreatment reading problems in, their 
children including 10 vocabulary problems (47.6%). 5 poor " * 
* comprehension problems (23.8%), 2 poor retention problems (9.5%), 
* 2 poor motivation 'to k read problems (9.5%), and 1 -too-rapid 
reading problems (4.8%). One response (4.8%) indicated that 
the parent? did not know if a "reading problem «had been ob- 
served. Asked if improvement had been- observed since Project 
Reach staff have been\forking iwth their children, 14 "(93-3%) 
of the fifteen parents* gave an affirmative response. Appendix , 
B, p. 9 presents* the results erf the Parent Questionnaire in detail 
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ADDITION AL FINDINGS . - , 

Ten perc.ent school principals who respc/hded to the Principal 
Questionnaire reported the following observations (See Appendix C, p. 14): 

• Seventeen benefits of the program fo^children include individualized 
instruction (n = 8; 07,0%) -small group instruction (n = 3;17.6%), 
flexibility to add and drop pupils as needs are identified 'and met "** 
(n = 2; 11. 8%), assistance of an educational aide (n = 1;S*&%) , and 
variety of materials (n =-l;5.9%) ■ . ^ 

Eleven benefits for teachers include a team approach by class 
room teachers and project staff to help children (n = 5;45.4%), 
direct communication between classroom teacher and reading special- 
ist (n = 4;36.4%), improvement of teaching techniques (n = 1;9.1%), 
and availability of 'supplementary materials (n = 1;9.1%), 

• 

Rather than administer the Stanford Diagnostic^Reading Tests to 
beginning Grade 1 pupils, the Metropolitan Readiness Tests (MRT) are given 
in order. to more Accurately assess the cfiverse range of pre-reading .skills 
present *at that level. The MRT were administered to first-grade pupils in 
the project schools. Average percentile, '5 core for 226 pupils was 16.6" '* 
far below the 33rd percentile qualification criterion for Title I service. 

Asked the extent which Reach Reactor (inservice sessions- aided 
in identifying specific reading needs of individual children, 36 of 48 
responses (75%) of classroom teachers of pupil participants were "very 
much" or "somewhat". Also, 32 of 48 responses (67%) indicated that the 
Reactor sessions aided teachers in planning instructional techniques to 
meet student needs to a greater extent than the previous year. (See 
Appendix D, p. 11) . 



SUMMARY AND CONCLUSIONS \ 

Project Reach,} a supportive reading:"education program operating 
in eleven public elementary schools^and one non-pu|jjic elementary 
school, providea supplementary reading' instruction to 314 pupils 
in grades one through four during the 1979-80 school year. The 
project staff numbered 22 personnel including one administrator, 
12 consultant teachers, and nine teacher aides. s^All three project 
objectives were attained. ' 
* < * " 

. Teacher recommendations (See Appendix D, p. 10) included more 
reliance on teacher referrals for project participant selection, 
inservice for classroom teachers, and the establishment of closer 
cooperation between classroom teachers and project staff. 



Project school principals recommended that the program be expanded 
to Grades 5 and 6 and that an annual assessment of pupil selection ** 
criteria should be conducted everySeptember (See Appendix C, p. 9). 



The response of only 15 of 68 parents to whom the Parent Opinion- 
naire was sent indicated the need of more effective parent involve 
m'ent in .the program. 
• » * 

Teachers and principals alike recommended* that the /project beacon- 
tinued based on the strength of observations reported in the res- 
pective opinionnaires. 

The strength of the outcomes indicated thart the project should 
be continued to the extent that alternative funding sources 
should^. be sought if Title I funds, are withheld. 
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Table 2 . 
Mean Group Gains of First, * 
Second, Third, and Fourth Grade Pupil 
Participants' of Project Reach Stated in Normal Curve Equivalents 
i (Gates'-MacGinitie Vocabulary and Comprehension Tests) 



i 

t 







Grade 


i 


• 1 

Vocabulary 


/Comprehension 


Level 


N 


Pretest 
Form 1 


Post Test 
Form 2 


nce' 

Gain 


Pretest 
Form 1 


Posttest 
Form 2 


NCE 
Gain 


NCE 


%ile 


NCE 


%ile 


NCE 


%ile 


NCE 


%ile 


1 


A . 


99 


36.25 


25.6 


43.69 


38.2 


7.44 


32.43 


20.2 


40.72 


32.9 


8.29 


• 2 




135 


•30.42 


17.fi 


39.92 


31.5- 


9.50 


24.80 


11.6 


37.95 


28.4 


13.15 


3 

i 


C 


100 \ 


27.38 


14.2 


35.46 


24.5 


8.08 


22.89 


9.9 


37.25 


27.3 


14.36 


i 1 


D 


78f 


29.22 


16« 2 


27.40 


14.2 


•1.82 


22.86 


9.9 


33.29 
1 


21.4 


10.43 . { 


Summary • 


412 


30.82 


1 18.1 


36.62 


26.? 


5.8 


25.74 


12.4 


37.30 


27.3 


11.56 
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f APPENDIV A 

CLEVELAND PUBLIC SCHOOL^ 
READING INSTRUCTION PROGRAM 
PROJECT REACH 
/ Pupil Rating ^heet * 



Teacher 



School 



. • ' »' Has-been receiving assistance 

from Project Reach staff. ' We are anxious t"o,leam from, you thfe ^ 
extent of reading progress- made by the above-Aamed pupil whem you 
recommend^ for project assistance in specif i£ reading deficient 
skills for whicK the-child received help. Pleas! return the. com- 
pleted rating sheet to the Division /of Research and Development, 
attn: '.Francis- D. Sullivan, Room *6 00 S, not later than Friday, 
July 11,. 1980. . - ' • 



a. As the teacher of this pdpil, please list the specific reading' 
deficiencies you observed which required Pro j e^fe* Reach assis- 
t&ce. ' * "* * . . ; *" <T . 



(See, P. 7) 
z ■ — 



b.' On, the reverse side of .this sheet* kindly rate this pupil.'s pro- 
gress in the referred'.ski^ls, after treatment . 



CONTINUED ON BACK 
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APPENDIX A (Cont'd) 
I CLEVELAND PUBLIC* SCHOOLS ■ 
- , * > READING INSTRUCTION PROGRAM * ' 
Project Reach 1979-1980 

Number and s Per Cent of Students in Sample Possessing Specific 
• Reading Skill Deficiencies 

(N = 46) ' 



Phonetic Analysis 
Vowel 1 (specify) 
Long sounds 
Short sounds 
Letter terms 
Vocal combinations 

Consonant (specify) 
Initial Medial Final 
Blands ' 
Special Blends , 

Basic Sight Words \ 
Structural Analysis 

Prefixes 

Suffixes 

Endings 

Component Words 

Reading Operation 

Line Skipping 
* Omissions, Substitutions 

Insertions^ .Reversals 

.Silent Reading * * 
^ Eye and Lip Movement 
Finger Pointing 



N 

10 
14 
21 
4 

' 5'' 



19 
15 
10 



N 



14 
14 
12 
13 



21.74 
30.43 
45.65 
I 8.70 
l 10.87 



41.30 
32.61 
21.74 



21 45.65 



30.43 
30.43 
26.09 
28.26. 



2.17 
2.17 



Oral Reading 
FluencyN 
Expression* 
^ Coraprehensi9n 
Word Sense ; 
Phrase Sense 
Sentence Sense 
Sequence - 
Main Ictea 
Literal Meaning 
t Inferential Meaning 
• Seeing Relation 
* .Drawing Conclusions 
Auditory Discrimination 
, Visual Discrimination 
Vocabulary 
Syllabication 
Alphabet* § * 

m JUiyming J 
Readiness 
. Retention, recall 
Following direction? 
Clusters * 
No deficiencies listed* 



c 

0 


iU. 0/ 






34 '' 


73. 91 


2 


4.35 


2 


4.35 


3 


6.52 


11 


23.91. 


9 


19.57. 


2 


4.35 


3 


6.52 


1 


2. '17 


4 


8.70 


6 


13.04 


2 


^.35 


10 , 


21.74 


2 


4*35 


4 


8.70 


3 ' 


6.52 


3. 


6.52 


\2 


2.75 


3 . 


6.52 


6 


13.04 


I 


2.17 







2.17 
4.35 



4 



( 
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APPENDIX A (Cont'd) 

CLEVELAND PUBLIC SCHOOLS 

✓ • 
READING INSTRUCTION PROGRAM 



4 N = 46 . 



PROJECT REACH 

AVERAGE OBSERVED SKILL IMPROVEMENT (PER CENT OF RESPONSES) % 
/ 1 ' Pupil Rating Sheet 
' (POST TREATMENT) 



honetic Analysis N ^ 


Very Marked 
Per Cent 


Marked 
Per Cent 


Adequate 
Per Lent 


Limited 
rer Lent. 


Poor 


7 r ~? — : 

• Vfowel (specify) 17 


J7.65 


A 1 1 O 

41 . 18 


1 7 AC 




U y" 


jiong sounds 33 


24. 24 


AO AO 

42 . 42 


1 Q I Q 

lo . lo 


1 C .1 c 

1 J. 1j 


n 

u • 


Short sounds -37 • 


27.63 


TH OA 

37 . 84 


o\ to 
24 . .52 


5 . Hi 


Ji HI •€ 


Letter terms „ 25 


12.00 


52 . 00 


i a nn 
16. UU 


i a nn 
lo . UU 


a -nn 

H . UU 


Vowel combinations '29 


10*34 


37. 93 


A 1 TO 

41 . 3o 


a on 
o . yu * 


J . HO 

— « — 


r 

onsonant (specify) * 4 


75.00 


0 


U 


Zt> . UU 


n 

f u . 


In^ytial Medial -Final 38 


42. 11 


31 .S8 


i r "7 n 

15.79 


in ci 
10.53 


n 

u 


Blends 33 


36. 36 


36. 36 


to 1 o 

18 . lo 


y . uy 


n 
U 


Special Blends 30 


23. 33 


33. 33 


33. 33 


A <:7 
O. 0/ 


j. jj 


asic Sigl\t Words , 22 


40.91 


• 36.36 


1 O 1 o 

18.18 


1 V 


r 

n * 
u « 


tructural Analysis 20 


10.00 


40.00 


20. 00 


"7 A A A * 

30 . 00 


U T 


Prefixes 26 


11.54 


46% 15 


O t AO 

23.08 


1 1 CA 

• 1 1 . 5,4 


7 AO ' w -- 

/ . oy i 


Suffixes , 26 


3.85 


53.85 


OT AO 

23. 08 


1 1 CA 

1 1 . 54 


1* AO 

/ • oy ' 


Endings . 26 


7.69 


57.69 


' 15.38 


. 19.23 


0 


Compound Words 29 


24. 14 


48 . 28 


O C\ £. A 

20.69 


£L A A 

o . yu 


n 
U 


eading Operation 3 - 


0 


0 


1 AA AA 

100. 00 


A 

u 


n 

U . — 


Line Stepping 25 


4.00 


28 . 00 


A O AA 

48.00 ' 


i a nn 
lo . UU 


a rfn 

H . UU 


Omissions, Substitutions 26 


7.69 


o £ no 

26.92 


T A C O 

34 . 62 


OA 07 

20 . y2 




Insertions, Reversals 24 


v 16.67 


o a o t 

- 20-83 


OCi 17 

29.17 


O Q 17 

2 y . i / 


4 1 7 
H . 1 / 


ilent Reading 1 


0 


- 0' 


1 AA AA 

100. 00 


i 

A 
U 


' n 
u 


Eye and Lip Movement 25 


12.00 


o o a a » 

28 . 00 


-* T C C\C\ 

3o . UU 


9 n nn 
zu . uu 


4 nn 

H . UU 

1 


Finger Pointing 22 


18.18 


22.73 


3o . 3o 


O O 7"J 


n 
U 


Rate - 25 


8.00 


28 . 0(3 


T £. A A 

36 . 00 


i a nn 
lo . UU 


i o nn 

1 Z . UU 












* 


Fluency 27 


• '3.70 


37.04 


33.3-3 


18.52 


7.41 


Expression 27 


3.70 


14.81 


44.44 


22.22 


1 14.81 


Comprehension- 35 


11.43 


14.29 


45.71. 


20.00 


8.57 


Word Sense * 26 


3.85 


30.77 


38.46 


26.92 


0 


Phrase Sense 26 


0 


26.92 


42.31 


30.77 


0 


Sentence Sense 1 27 


3.70 


22.22 


51.85 


22.22 


0 


Sequence . - . 30 


10.00 ' 


30.00 


46.67 


10.00 


3. 33 


Main Idea ♦ 29 


6.90 


24.14 


41.38 


20.69 


6.90 


Literal Meaning 27 


3. YD 


25.93 


44.44 


22.22 


3.70 


Inferential Meaning 24 


8.33 


/ 12.50 


41.67 


• 29.17 


8.33 


Seeing Relation 24 " 


0 


16.67 


45.83 


29.17 


8.33 


Drawing Conclusions 26 


3.85 . 


. 26.92. 


38.46 


23.08 


7-69 



AVERAGE IMPROVEMENT 



14. # 



29.63 



35.63 



16.93 



3.73 



Division of Research and 
Development, June, 1980 



THANK YOtf 
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APPENDIX B 



cleveland public schools 
'reading instruction Program 
* project reach 

Parent Opinionnaire , 



N = 15 



1. 
2. 

3. 



fyour child 



Jias had help 



in reading from Project Reach. We are interested in 
having you tell us how you feel about what this program 
has done for your child's reading. Please answer the 
questions and return the questionnaire in the enclosed 
self -addressed envelope to your child' 1 s teacher before 
July 11, 1980. THANK YOU. 



~ ; 7 ■ (13.36%) 

How many children do you have in grades one through four? 1 Child = 2 



(33.33% 
3" Children 

/ ^'i^^ 1 w " ~ w / w — **~ ' ~ ~ o-- _ 

n- = 15 ■ . 2 Children = 84 Children 

What grade is the child in who receives help in reading ifrom * (53.34%) 
project staff? Gr.l = 2, Gr. 2 = 8, Gr. 3 = 5, Gr. 4 =*0 

- (13.33%) ' (5*. 34%) (33,33%) § x * 

In your opinioir, what are your child's reacting problems? 
n = 21 - - Q 

Pdor comprehension = 5 "(23.81%) . . 4 Vocabulary study problems = 10 (47.62-6) ... 

Poor retention = 2 (9.52% ... Reads too rapidly = 1 (4.76%) ... Poor motivation 



to read = 2 (9.52%) ... I' don't know = 1 (4.76%) 



I 

4. Have you seen improvement since Project Reafih staff have been working 
with your child? Yes [It] * ~""~No [1 ] 
n = 15 * (93.33%) (6.67%) 

rPlfease explain below 1 
.# = 1-6 

Better reading comprehension = 3 (18.75%) . .. More interest in reading show n = 5 
('31.25%) ... Difficulties with pronunciation and word, understanding remain =* 2 ... * 
12.50% .. .Better vocabulary skills Shown « 2 (12.50%) ..^Overall reading i mprove - 



ment noted = 2 (12.5&) . . None listed = 2 (12.50%) 
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5. Have you observed your child's reading since September: * , M a 

n = 15 ~ ' * rAno^ (Ac. (L-io^ Response 

(40%) (46.67-o) (1 ^ 33%) 

* - . in the classroom?- - ( Yes ] No [7 ] 2* 

- * " (40%) (46.67%) , (13.33%) 

• in the Project Reach center at school? Yes [g-J No [7 J '2 

• v ' . ' ■ 

6. How do you help your child to improve reading skills at home? n = 2*0 

Take turns reading aloud with child = 4 (20%) . ,T Question child abUut" content 
» * - ■ 

after reading = 2 (10%) ... Check pronunciation skills = 2 (10%) ... Cheeky spelling 
- ^ . 

skills = 1.(5%) ... Provide vocabulary work =^6 (30%) ... Play word* games = 1 (5%J 

r : — 1 ' 

... Provide organized family reading activities = 3 (15%)... No response = 1 (5%) 



y- 



7. How can you tell that your child 1 s* readirig is improving since receiving 
help from Project Reach? 

n = 6 • * 

Improved readin g skills shown = 9 (56.25%) ... Improved interest in reading sh own = • 

3 (18.75%) ... Improved speech skill s shown = 1 (6.25%) ... Improved vocabular y skills 

-T : j 

shown = 1 (6.25%) ... I don.'t know = 1 (6.25%) ... No response = 1 (6.25%) 



8. What are your suggestions for helping to improve programs of this nature for 
children in the future? n = 15 * 

Continued .participation in the project = 2 (13/33%) ... Wprkshops far parents = 1 
(6.67%) .:. Have morfc projects like this = 1 (6.67%) ... Continue the project as 
it is; no suggestions = 6 (40«) ... I don't know - 1 (6.67%). . . .>*fcJo response = 4 

(26.67%) 1 

9 ^ Division of Research and Development 

June,- 1980 

THANK YOU 



I • APPENDIX C 
CLEVELAND PUBLIC SCHOOLS 



"READI^ INSTRUCTION PROGRAM 
^PROJECT REACH 
Principal Opinionnaire 3 



N = 10 



School 



We are interested in securing the opinions of 
principals in whose 1 buildings Project Reach is operative. 
Please respond to the following questions and return your 
opinionnaiW to*' the Division of Research and Development 
attention: Francis' D. Sullivan, Room 600S, by Friday, 
? July 11, 1980. THANK YOU. 



How many primary classes (grades 1-3) are in your Building? 



70 



(7,0%) "(20%) 

Were any of your fourth grade glasses included? Yes [7 J No [2 J No respowse 
n = 10 , 
How many? 



0 



18 



.What did you consider to be the strengths of this, program for .children 
this year? n = 17' , . 

■ " • ' ' : * * 

Individualized instruction = 8 (47.06%)... Small -group instruction = 3 (17.65% ) 

.:. Assistance of an educational aide = 1 (5*. 88%) ... Variety of materials = 1 

~T : ' ^ ' : 

(5.88%) ... Flexibility to add and drop pupils as needs are identified 

and/met ~= 2 *(11\76%? . . . Reinforcement of regular work = 2 (11.76%)'. 

Whalkdid you consider as strengths of this program for your teachers this year? 

n = * « \ 

Direct Communication* with Reading Specialist = 4 (36.36 o) ... Combined efforts 

of classroom teacher and program staff to help children = 5 (45.45%) ... Improvement 

~ ; - 7 

teaching techniques ^1 (9.09%)/,,, Availability of Supplementary materials = 1 (9.09 

What are your recommendations for operating programs of this nature in the future? 
n = 12 \ 

Continue the program = 6' (50%) ... Expand to upper gnades « 2 (16.67%) The pro gram 
operates well as it is = 1 (8.33%) ... Conduct annual assessment of selection 

' " * : ^ 

criteria in September = 1 (8.33%J . Serve additional students = 1 (8.33%) ... 



Provide full-time consultant = 1 (8,33%), 



THANK YOU 
-100- * 



Division of Research and Development 
June, 1980 
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APPENDIX D 

CLEVELAND PUBLIC SCHOOLS 
READING INSTRUCTION PROGRAM 
PROJECT REACH 
Teacher Opinionnaire 



N = 46 



One of the prime, objectives* of Project Reach is the 
dissemination of promising practices to participating teachers 
to facilitate, the use'of different reading techniques and differ - 
ent reading materials with pupils . Please respond to the items 
on this opinionnaire , seal in the enclosed envelope? and 
Return to Francis 'D. Sullivan, < Robm 600-S, Division of Research 
ami Development, not lat^r. than Friday, July ^1, 1980. TiiASIK YOU r 



(3.77%) 
No Response - 2 



What grade do you teach? 
n = 51 



(28.30^) (33.96.%) (20.75%) (13.21%) 

First [15] .Second [18] Third [11 ] Fourth [7] 



To what* $*fctjnd 4 have the Reach Reactor sessions this year aided in: 

a. "identifying specific reading needs of individual 

children? 

n = 48 (52.1%) ' (22.9%) ' (p%) 

very much [25] somewhat' [111 a little [0J 

(6.2%) 

not at all [3] No Response = 9 (18.8%) 

b. planning instructional techniques to meet those needs 
. to a greater degree tflat what you did last year? 

- n ,= 48 . (22.92%) (43.75%) (2.08%)* 

very much [11 ] somewhat ^ [21 ] .a little [ 1 ] 

(8.33%) 

1 not at%ll [4] No response = 11 (22.92%) 



CONTINUED ON BACK 
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• * 

To what extent do you feel, more comfortable in tHe use of diagnostic 
prescriptive technique? gained . through your involvement with Project 

n * 48 (16.67 %) (39.58%) (14.58%) (6.K%) t 

very, very much [8 ] more than expected [19] somewhat [7 ] a little [3 ] 
v . . (8.33%) ' ' s ' -(14.58%) ' • 

not at aid ' [ 4 J No Response = 7 * » 

- l\*hat teaching techniques directly gained from Project Reach, have you , 
u^l with pupils in your* classroom? 

n = 59 • (1.70%) 4 (1.70%) 

Diagnosis-Prescription* - 1 ... Use of supplementary materials - 1' . 

rg 47^1 • 20%) 

Teacher-made activities - 5 ... Various sKiiis - teaching techniques - 19 

] t (8.47%) (25.42%) " (22.0'3%) 
Games - 5 ... No-techiliques listed - 15 ... No response - 13 



^ - * 7- 



What arc your recommendations for operating programs pf this -nature in the future? 
n = 52 * (13.46%) \ , 

Continue the program as it is - 7 • ... Rely more on teacher referrals to select 

f5 27%) • f3 85^1 

participants -3 ... Inservice classroom teachers - 2 Establish closer 

: ; - (17.31%) 1 

cooperation between classroom' teachers 'and projdbt staff - 9 ... Expand the 

' I/. 69* j * ~ ; = : ; (13.46%) ; 

program - 4 ... Other recommendations (various - 7 . . , No recommendations) 
CF.T75] (3776^) ; ; 



listed - 3 ... No response - 17 



) 



Division of Research 5 Development 
June, 1980 
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PROJECT STAR 



' Prepared by 

i - 

i 

Ronald E. Gerboc • 
Research Associate 
4 

T>$ed by 
Dorothy Brown 



► Margaret Fleming 



s 



' Deputy -Superintendent 



,1979-1980 



4 

J . 
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PROJECT STAR 



1979-e.O Title I Evaluation 



> 1 ' c 



£0 



PUkPOSE AND OVERVIEW 



Prefect 'STAR (Skills Training for Achievement in Reading) offers 
eligible junior highf^Bchool students who are below average readers special 
instructional assistance in Reading and study skills. During the 1979-8(5 
school year, three types of instructional treatment were maintained J>y the 
project.' Those Grade 7 students who were", placed in the project. 1 s BJLo€k 
Classes obtained four periods (approximately 3 hours) of reading and^stuciy 
skills instruction p$r day foV an entire school year. In addition, if 
scheduling permitted, most of these same students were provided with an extra 
period (45 minutes) of Learning Center assistance per day during the year! 
Such assistance wa£ contributed by certificated reading specialists, English 
te'achers, social studies teachers, and educational aides, In' addition, the * 
project offered students in 'Grades 7-9 the opportunity to ^participate in a 
Learning Center. A certificated reading specialist or 4 Engfish teacher and 
educational aide provided Center participants with one period (4j> giinutes) 
ot reading instruction per day for the entire school year. A third type of 
treatment was* offered to students in the participating non-pub'lic Schools. 
, In these schools, Grade 4-8 student participants received one period (45 . «, 
minutes) of daily educational aide tutorial reading support. 

SERVICE SUNfrlARY- . ' ' 

. Number of Pupils Served : 2, 753- {public^ -Grades Served; - ~ 7-9 ^publie}- 



Number* of Schools; 23 (public) 

10 (non- pub lie) 
W 33 Total 

Staffing : 1 Project Manager (FT) 

.4 Consultant teachers (FT) 
' * 70 Teachers (FT) - 

Total Title I Expenditures : J2, 549,470 
OBJECTIVES AND OUTCOMES 



357 (non-public) 

Years in Operation : 



•4-8 (non-public) 

14 - 
4 



76 Teacher y Ai'dtes (FT) 
' 2. Social Workers (FT) 
3 Clerki (FT) 

\ 4s 

Per Pupil C^st : $820^ 

» * * • 



< 



SPECIAL NOTE : Prior to examining the presented ^findings, it is important that 
the reader be made 'ajvare of the disruptive £actors**which project managAnent', 
public -school staff, and public School students hSd'to contend with during the * 
implementation' of program operation, (The ten non-publdc participating schools^ 
experienced a routine school year.V , j * 

, , The United States Distfict Court ori July 30,-1979, accepted the ' 

Cleveland Board of Education's proposal which called for systemwide desegregation 
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.to be completed in 'three phases starting in FaJLT, 1979. Although most of the 
piiblic junior high schools participating in Project STAR were 'not directly 1 
involved in first semester (Phase I) desegregation plans, preparation 
related to this evei£ did impact project operations. The start 1 of the 
school year, for- example, was .delayed one week to permit employees of 
Phase I schools the* opportunity to 'attend desegregation meetings .\ # Also', a* 
lengthy teacher work stoppage closed the school system for more than two 
months (I.e., from-4fovember 7, 1979 to January 7, 19&0) . *As.a consequence, 
all Vacation time scheduled during the remaining ^chool year was eliminated 
and the closing date of the school year was extended from June 13; 1980 to 
July 23, 1980. _ / . % . \ % 

Finally, beginning the second semester- (March 17, 1980) all publio 
junior high schools, were impacted as a result of P hase II desegregation 
implementation. As part of the Phase II plan, Project S>TAR was mandated to 
provide "services in all 23 public junior high schools. A massiVe reassign- 
ment of project staff and students occurred in efforts to comply with this 
mandate. Consequently, the T amountof project assistance students, received 
varied. Approximately 55 percent (or 1,502 of the 2,753 public school 
students served) obtained project services for the entire year, while the 
.remaining number of , students served (approximately 45% or 1,251 students) 
received assistance for not more than one semester. * , * 

The achievement -results cited in the Objectives and Outcomes section 
of this report represent the efforts of those students who received' a full 
year (38 weeks) ot project .instructional assistance. These outcomes have been 
presented according to the type of instructional treatment provided to these 
full year stutffent participants (i.e j . , Block Class, Learning Center, or non- 
public instruction). The achievement of these three groups should NOT be 
compared because there x is no way of being certain 'that eligible students were- 
randomly assigned to treatment group within each participating project school. 

AS a result, systematic sampling biases may be present. It s\ould also be 
noted that the length of instruction and number of trained individuals 
providing instructional support to_ students t varied among treatment types.. 
Refer to the Purpose and Overview section of this report to obtain a more . ' 
detailed discussion of treatment type difference's. (Attachment A contains a 
complete list of participating schools and other information related to the 
instructional services provided within each school.) 

. Product Obj-ective la : Project STAR Block. Class and Learning Center 
participants will evidence a mean gain of at least four NCE's in , 
test soares as reflected by pre/post Stanford Diagnostic Reading 
Test '(Brown Level, Form A) scores in (1) auditory vocabulary and 

# (2) total reading comprehension. * 

* . Outcomes : The Stanford Diagnostic Reading Test was administered 
to all STAR public school participants in late September, 1979 and 
>/th.e middle of June, 1980. A total of 137 instructional days were 
included within this period. As previously explained, a'lengthy 



*Because project assistance in fche non-public schools focused prima***!) upon 
everyday reading and study skill development, student participants were not 
administered th.e Stanford Diagnostic Reading Test. 
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^ employee work stoppage occurred within this pre/post test period. 
S This event caused an interruption of 43 days in instructional ass- 
istance between the pre-test and post-test administration. * 

• Data indicate £hat Product Objective la was attained'' by the Grade 7 
Block Class participants . (Block Class participation was limited to 
Grade 7 students only). Analysis of pre/post SDRT (Browi^ Level, 
Form A) standard scores* revealed a mean auditory vocabulary N&E gain 
of 7.80 (N=345) ~ from 28. 29 to 36.09 and mean total .reading 
comprehension NCE gain of|5.05 (N=336) -- from 26.49 to 3}. 54. Eacli 
of th^ two subtest, gain scores' exceeded the proposed criteria (i.e., ' 
at least 4.00 NCE mean gain). • 

Data indicate ^that Product Objective la was not attained by the 
Grade 7 Learning Center participants . Analysis of pre/post SDRT 
(Brown Level, Form A) standard scores for STAJ* Learning Center, parti- 
cipants revealed t*hat Grade 7 students obtained a mean auditory 
vocabulary *NCE ^gain of ."01 (N=244) from 32.66 to 32.65 arid a mean 
total reading comprehension NCE gain of + 1.87 (N=219) — from 30.19 
to 31\99. Each of the two subtest gain scores did not 'exceed the 1 
proposed criteria tire77~at least- 4.00 NCE mean gain). 

Data indicate that Product Objective la was not' attained by Grade 8 ' 
Learning Center, participants . Analysis of pre/post SDRT (Brown Level,- 
FormA) standard scores for Grade^8 STAR Learning Center students # 
revealed that the sample group obtained a mean auditory vocabulary NCE 



gain of - 2.18 (N=80) from 33.l6^€o 30.98 and mean total reading 
comprehension NCE gain of - 2.56 to 25.00. Both subtest gain scores/ 
did not exceed the proposed criteria (i.e., *at least a 4.00. N^E mean - J 
gain). (It should be noted that b.ecause Spring norms are not available 
at the eighth grade level, ninth" grade Fall norms' were used to 
interpret the eighth grade post scores). • - 

Although approximately 175 Grade 9 students were served in the Project f £ 
. " Learning Centers, Cleveland's 1979-80 city-wide test program did'not 
include Grade 9 pupils in ^the SpRT test administration. As a result, 
SDRT pre-scotes were unavailable* for this group of students. * 

* " 1 r , ' ' \ 

^(Attachments B-l through B-6 present achievement test results for 
"schopl 'years '1977-78, 1978-79 and 1979-80)'. \ 

. Product Objective 2a : Project STAR block class participants will evidence 
a significant increase (p.< .05) in pre/post Everyday Skills Tests mean 
raw scores in Reading (Test A).** , v * 1 } p 

V 

*(a) The tontent of the Everyday Skills Test (reading and study skills) reflects 
the instruction al objectives w hich guide Projf£t STAR'S Block Class social 
studies curriculum as well as the non-public skills, improvement assistance 
pAgram (b) 'Both public and non-public school EST results represent the progress 
made by Grad'e 7 students only. Block Class participation was limited to Grade 7 
•students, while "the number of ^on-public students from Grades 4, 5, 6, and 8 were 
too small to warraiits separate evaluation presentations, (c) Public school, 
testing occurred during the middle of October, 1979 and latfe June, 1980*, Non- . 
public^CHool testing took place in the middle of September, 1979 and^ late .May, 
1980.^ . ! ' * " - . 



Outcome : Data? indicate that Product Objective 2a was attained by the 
public school Mock Class participants . EST (Test <PC) reading raw score 
results* indicated that the-total sample" of 288 public" school Block 
" Class participants evidenced a mean pre/post gain of ,3*9S — from 
26*32 to 30.27. The reading test contains a total of 45 items."" The 
increase was demonstrated to be statistically significant (t=11.62,' - 
p.<.001). (Attachment ^presents ESt. Reading test Te N sults ,for 
school, years 1977-78, 1978-79 and 1979-80). 

Data indicate that Product "Objective 2a was attained by the non-public 
^school participants . An analysis »of pfe/post EST (Test A) reading raw 
score for STAR po*<-public student participants revealed a mean* pre/ _ 
post gain of 2.59 (*I=150) -- from 33.26 to 35.85. The increase was 
demonstrated to be statistically significant (t=6.87, p.<.001). f 

Product Oft^ective 2b: Project STAR block Glass participants will evidence 
a mean gain of at leasj, four NCE 1 s in test score as reflected by pre/post % 
Everyday Skiils Test scores in Stucfy Skills (Test B)\* 

. Outcome / Data indicate that Product Objective 2b was not attained fey 
the public*, school Block Class participants" ! Pre/post EST (Test B) 
*NC£ scores obtained from 274 public school Blqck Class participants 
revealed a mean study_ skill NCE gain of* 1.02 -- from 20.59 to .22.01. 
The gain, however, failed, to exceed the proposed erit^rioiwjf perfor- 
mance (i.e., at ,leas f t a 4.00 NCE mean gain). (Attachment £-6 presents 
EST study Skills te$t results for school years 1977-^8, 19*78-79, and ' 
1979-8-0). ^ , 

Data indicate that Product Objective 2b was not attained by the non- 
public school participants . A review of EST (Test B) study skill 
results indicated that the sample of 149 non-public school STAR 
participants evidenced a mean NCE gain of 3,58! — from 31. 09 to 34.66. 
The* gain, however, failed to exceed, the proposed criterion of perfor- . 
mance (i.e., at least a 4.00 NCE mean gain). 



Product Objective 3a : Project ST^R Block Class and Learning Center 
participants will attain an" average 1979-80 attendance rate equal to or 
better than the average attendance rate for all other 7th and^ 8th Grade 
pupils within the participating 9chools. ' v 

\ Outcomes : Data indicate th^t Product Objective 3a was achieved by 

Grade 7 Block Class students / A A review of the 1979-80 attendance" for t 

the 14 participating public schools that offered Bttfck Classes revealed 

- that the 80 percent rate of attendance recorded for .the Grade 7 STAR^ 

student participants equaled the rate (80%) evidenced by the^remaining 

Grade 7 students within these same schools. Nine of the fourteen . . * 

* schools (or 64%) achieved the proposed attendance criterion; Refer to % 

Attachment C- I f or individual school results. (NOTE f The only group. 

served by STAR" Block ^Classes were Grade 7 students). , • 

* • % 



*Refer to footnote appearing on page 2 of this report. 

• \ 
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Data indicate that Product Objective 3a was not attained by Grade* 7 
Learning Center students " Grade 7 STAR Laming Centej attendance 
data was available for*14 of the 23 publidp junior high schools- that 
offered such qlasses. Among the remaining eight schools with Centers, 
one school failed to submit attendance data, two schools; did not serve 
Grade 7 students,, and* five* schools established Centers/ fob late in* the 
year (May, 1980) to qollect z&fcqqate data. A ctjmparison of the 
1979-80 rate of attendance" fOT^tfte Grade* 7 STAR Learning Center 

, students t (75%)' and the ra^e of attendance recorded for the remaining 
Grade 7 student's (80%) revealed that the Grade 7 STAR students did not' 
.equal *or exceed the rate of attendance of their remaining Grade 7 
student counterparts v Three of fourteen .'schools (or 21%) achieved th,e ; 

'proposed attendance criterion. Refer to Attachment C-2 for individual 
school results, s ~ . - 

Data indicate that Product Objective 3a wfls^not attained by Grade 8 / 
Learning Center students . Grade 8 STAR Learning Center attendance 
data was available for 15 of the 23 public junior tfigh'schools that 
of fered i&ich clashes. Among the remaining seven schools with Centers, 
one school, failed to submit .attendance data,- « one school did not serve. 
Grade-8 students, and five schools established Centers too late in the 
year- (May, 198,0) to collect" adequate data* A review "bf 1979-8'0 
attendance for 15 participating public schools that offered Learning * 
Center Classes %o Grade 8 students revealed that. the 69 percent rate 
of attendance recorded for these Grade 8. STAR students did not equal" 
.or exceed the rate (79%) evidenced by the remaining Grade 8 students 
within these same schools. Two of fifteen schools (or 13%) achieve;! 
the proposed attendance criterion. Refer to Attachment C-3 for 
individual school results. * 



Process Objective- la : The educational aide will complete a minimum^jf 
two^home contacts with the parent' or guardian of 80 percent of the STA£ 
Block. class and Learning Center participants v & ' '< 

• » • 

. Outcome : Data indicate that Process Objective la was attained -by 
public school educational aides . A review of the P r °j§££ !jS parent 
involvement records indicated that at least two »home ccSpTacts were 
made with the parents or guardians of 79 percent of the public school 
participants who were enrolled in. the Block and Learning Center 
classes (i.e., 2,202 of the 2, 753~students) . Although the actual 
percent of parents contacted' a£. learst^twipe was slightly less than 
what was proposed (i.e^;79% vs. 80%), this evaluator considers the 
parent^ contaci objective attained. Home contacts # were made to 
* familiarize the pareWts of each student participant with program's , . 
instructional rationale and theit child's reading skill development. \ 
Parents were also provided with suggestions in how they can encourage'- 
and assist their child to improve his/her reading skills* 

♦ 

Process Objective lb : Each ESEA Title I Project STAR junior high school 
will have a Parent Ajivisory Committee. 

„ Outcome : Data indicate that Process, Objective lb was attained by each. 
Project STAR public junior high school . A 7 review of the project's 
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parent involvement records indicated that each participating public 
school (N=23) established a Parent Advisory 'Committee. As a 
consequence A ^ total of 43 public school parents were actively 
^engag^d in attending regular^ scheduled committee meetings held ,at 
their, local schools; The intent of these meetings was to involve 
parents the project's instructional procfess by providing them with 
up-dated information regarding classroom instructional innovations, 
newly purchased^ educational materials/ equipment, and the progress 
being made in their respective school's project classrooms. 

Although non-public schools were not required to establish their* o%hi 
Parent Advisory Committees, they were encouraged to send representative 
parertts to their local Title I district school and city-wide committee 
meetings. . , \ 



SUPPLEMENTARY FINDINGS 



Achievement* Tests Percentile Scores 



The request is frequently made to "relate project, achievement to the 
national norm group. The table presented below provides the percentile rank of 
the mean pre/post NCE scores attained by students^on the various standardized 
test instruments used- during the 1379-80 funding year. 



8 , 






Pre-Test 


Post-Test 


• 

Grade 

* 


*> • 

* Test/Subtest 


Treatment 
Type 


Testing 
Date m 


t-ile 


Testing 
Date 


%-iIe 


7 

4 

-i 


SDRT Auditory Vocabulary i 
(Brown LeVei; form A) / 

SDR'tflBkftg Comprehension 

■ (Broira m, Form A) 


Block 

Learning Center 
Block 

Learning Center 

I 


9-79 
9-79 

9-79 
$9-79 * 


IS 
20 , 

% 

>V 


6-80 
6-80 

6-80 
6-30 


f as 

20 

. 19 
19 


.. '. / 


EST Study Skills 

(Adopted from CTBS Form 'R, 

Level 3) ' ' 


Block 
Non-publ ic 


10-79 
9-79 


8 
18 


6-80 
S-80 


23 


8 


SDRT Auditory Vocabulary . % 
(Br£wn Level, Form A) 


a ^ i . 

Learning Center 


9-79 


21 


6-8J? 






SDRT Reading Compipehension 
(Brown Level, Form A) 


Learning Center 

* 


z 9-79 

4 


14 


6-80 


11 



As demonstrated, all student post achievement scores (public and non -public 
fell below the 33rd percentile* on both the p*e test and post test of the SDRT- 
Participating Grade 7 Block ciass and non-public students, however, achieved 
prog^fess that exceeded what would normally have been expected without receiving 
project services 'in each sub-test area. Learning Center students an both Grade 7. 
and 8 failed to demonstrate similar results ( i . e . , the only Learning Center group 
to demonstrate an improved post percentile score were Grade 7 students in the 
reading comprehension sub-tesfr area) . The reader must be. reminded that Block 
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Class and Non-public students obtained a greater amount of project instructional 
assistance per day than their Learning Center student counterparts. .(Refer to 
the SPECIAL NOTE appearing on page 2 of this report for a^more detailed 
description the types of instructional ^assistance that were offered). 

• / 

' Survey of Project Teachers * * 

Efforts were made to ascertain how STAR 'Block Class and Learning 
Center Teachers viewed their involvement in 1979-80 project activities. To 
accomplish this effort project teachers (N=65) were asked' to anonymously respond 
to a seven item locally constructed survey questionnaire. The following 
summarizes the major findings obtained from the. responses of the 42 teachers who 
returned the survey. (Ref.er to Attachment D for complete survey results)^ 

* 

. fh& majority of the STAR teacher respondents (62%) indicated that 
this year's work stoppage did not create problems which affected 
the implementation of project activities. Thfcse respondents (20%) 
who did feel that their activities* were affected for the most part 
cited the required extension of the*-schocfa year and the detrimental . * 
influence it had on student attendance and motivation as being the 
major disruptive factor. No response was indicated by nine percept 
* * (9%) of the remaining teachers who returned questionnaires. 

. A majority of the teacher respondents (57%) reported encountering 
difficulty scheduling students into their STAR classes. Learning 
Center teachers appeared to have encountered the most difficulty. 
These teachers were required to locate eligible students «vho had + 
study hall assignments and 're-schedule this time for participation 
in Center activities. This process took place because Learning 
Center classes were not programmed into the master school schedule 
at the beginning of the school ye2&. As a result, teachers reported 
that many qualifying students who did not have study halls were^ 
unable to be scheduled for Center participation. Further, they re- 
ported that many students resented being taken from study hall and 
placed within a class (Learning Center) that they did not elect to 
participate in, and that guidance counselors tended to view the 

^scheduling of STAR students as a low priority item or nAk tfceir 

'responsibility. 

. Block teachers were asked to rate the value of the unique operational 
features of the project in terms of promoting student l>earning ? An 
overwhelming majority (80%) of the 20 respondents indicated that the 
v double period c^f English and sociatl studies instruction which Block 

Class students ^r^ceived was "essential" or of "much value" in pro- 
moting student learnings The # remaining respondents believed that such 
scheduling was of "some value" (5% of the respondents) or "little or 
no value" (15% of the respondents) . The majority of these same 
teachers (70%) believed the Block teacher's presence in the vocational 
education classroom was of only, "some valu§" or "little or no value". 
The remaining respondents (25%) found such a presence to be "essential" 
or of "much yalue". No response to this question was obtained from 
five percent of those who returned questionnaires. 



cj More than three out of evtery four teacher respondents viewed the 
.instructional support- assistance provided by the project's 
educational aides as being helpful. A comparison of the "more l;han 
. adequate f 7"adequat,e^ versus "less than adequate" ratings revealed 
the following results. The catergories rated included^? "ability 
to do assigned work" (78% vs. 17*) J "willingness to do. assigned 
work" (85%' vs. 10%), and' "quality of jactual job performance" 
(91% ys. 14%). In each of those categories five percent of those 
.who returned questionnaires did not respond. ' s 

. Half of the teacher respondents (50%) felt- that the other faculty 
-members in their building viewed Project STAR'S efforts to improve 
student reading^as being "essential" or of* "much value", while ^ • 
59 percent indicated that their faculty viewed such efforts as being 
of only "some value" or "little or no value". No response was 
indicated by *11 percent of the those returning questionnaires. 

. Three every four respondents (74%) indicated that the project's 
'staff inse'rvice efforts were "very helpful 11 or "helpful", while an" 
equal percentage .of the teacher respondents (74%) indicated that as 
a result of these efforts their classroom instructional approach 
changed "alot" or Vsome". In addition, the majority of th'ese'same 
respondents ihdicated that the "number of 'sessions offered" (54%) 
and f Jtime spent presenting each topic" (52%) should "continue as is" 
•next year. Almost half of these same respondents believed that the 
"^variety 'of topics"* (49%) and the presentation of "suggested teaching 
strategies" (40%) should be increased. 

A number of project features were consistently listed by the teacher 
respondents as haying "contributed most to classroom Effectiveness". 
These features -included: low student to teacher' ratio) which 
permitted a high*degree of individualized instruction, the double 
period of English and social studies, and high inter*est-low, difficulty 
project resource materials. Listed more often as being a factor 
"mos£ detrimental" to pupils 1 learning were the following items: *; 
inadequate scheduling process for Learniivg Center students and the 
exclusion of matKematics instruction from the STAR program. 

. The most common recommendation made by teacher respondents to improve. 
' the services offered to students included providing Learning Center 
teachers with a computerized list of eligible students that contained 
standariz'ed test score and study. hall information. 



SUMMARY AND CONCLUSIONS 

It is very difficult to make a definitive assessment of Project STAR 
. , effectiveness dtiring the 1979-80 school year. As noted, two un- 
precedented disruptive influences .were encountered which cannot be 
* . oyerlook^a wken. feya.lua.tin^ the progress made by project students (i.e*. 
the long term work stoppage and massive reassignment of teachers as 
well as students during Phese II of desegregsrtlon. implementation). 
Although the^najprity. of STAR teacher survey respondents (62%) felt' 
that the* work stoppage did not interfere with the implementation of 
project services, the adjustments staff and students had to make due * 

' '• . " ' • -mi H i 



to the alteration in the school calendar and desegregation reassignments 
undoubtedly had a tremendous influence on project staff morale*and on 
tKe students 1 ability^.to concentrate on a prescribed learning process. 1 

Despite' these disruptive influences, Block Class students did demon- 
strate attainment of the proposed SDRT vocabulary ajid reading compre- 
hension criterion (i.e., at least a 4,00 NCE mean gain), the proposed 
attendance criterion (i.e., t rate of attendance equal to their Grade 7 
counterparts) and the EST reading criterion (i.e., significant increase 
in pre/post- mean raw scores). Block Class .students failed to attain 
only on^proposed product objective (i.e., at least a-4~a)0 NCE mean gain- 
irt pre/post EST study kkiil score). Learning Center student participants 
failed to attain proposed criterion, in any of* these product objective 
.areas. While non-public school participants, who experienced abnormal 
school year, achieved the I-ST reading product ob-jeetive criterion, they 
did not attain the EST study skill proposed criterion. 

Although three treatment group test results. should not ~T5€ "fcftmpared 
because students in these grpups may have already been different in 
important ways, it would be profitable to condiKt a #tudy which adhered 
to recommended research guidelines in an effort to ascertain the effect 
treatment type and length has on student performance. Such a study" 
would be especially appropriate considering the noted differences that 
occurred between treatment group performance during the* 1979-80 schooj. 
year. - ' t • • , 

As of this writing, decision^ have been m^de to eliminate the Block Class 
fqrmat in favor of^the Learn/ng Center organizatidn during the 1981-82 
school year. Although one must be extremely cautious in making compa- 
risons between the Block and Learning Center results, nothing in the data 
indicates that the Learning Center organization does a better job in^ 
promoting student achievement and attendance *than fhe Block Class format. 
The available data, in fact, suggests the reverse. Consequently, bifore 
permanent changes are made in the STAR* organisational structure, a 
thorough review of this issue should be accomplished to irfsure maximum 
instructional impact. 

More than half /(57%) of the STAR teacher 'survey, respondents~feported 
experiencing difficulty in scheduling students into their classes. x 
Learning .Centex teachers, appeared to encounter the most difficulty. Marty 
of these teachers stated that 'student resentment was encountered whe«<~ 
student study -hall assignments' were cancelled to insure STAR partici- 
pation in STAR Learning Center activities, fhis resentment may have 
contributed to the poor achievemept and attendance demonstrated by ^ 
Learning Center students. Block Class students were automatically 
progAunmed for a full year of participation in STAR activities s at the 
beginning of the school year when all student assignments within schools 
were issued. Block Class students demonstrated progress that exceeded 
what would normally have been expected without receiving project services 
in all but one product objective area. This finding suggests that 
program Management re>y.ew future scheduling* procedures with the intent to 
promote a more positive student attitude* regarding Project STAR 
participation. 
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When asked to rate the value 'of -Various operational features of the 
Block Clas^ organizati<?n, an overwhelming majority of Block Class 
teacher respondents considered the double period of English and social 
studies, ^and the variations in the second period of the students 1 
Block schedule (i.e., English-reading lab participation and social * % 

, studies resource teacher assistance) as being instrumental ^in promoting 
student learning. It appears, therefore, that it would be profitable 
to recommend scheduling English class and reading lab participation 

. a unit when the master schedule in each junior high school is 
developed. % , j 

Despite the fact that the 1979-80 STAR participants did not demonstrate 
attainment of the proposed criteria on all achievement subtests 
administered during the school year, the recorded gains made in many 
of the subtest areas^did indicate that students* demonstrated progress 
that averaged beyona what wgjald normally have been expected if they 
had not received project services. The unusual events that occurred 
during the school year and various organizational problems previously 
mentioned* may have had a negative effect on-student performance out- 
comes. As noted, however, the project has continued to demonstrate 
that its efforts have beneficial results throughout its fourteen years 
.of operation. This evaluator, therefore, recommends that project 
efforts continue* to receive prime funding consideration. 
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APPENDIX A 



PROJECT. STAR DEMOGRAPHICS 
1979-1980 * f 



Schools 



Participating -Public . Schools .and 
' No., of Components Within Schools 

No. of Components Within Schools 



Cob po sent 



Block 
Classes 



fesrade 
jf ■Partic* 

AM Hart 



Learning Center A 
New Century Read 



Learning Center B 
Co nwun icat Ion < 



Learning Center C-l 
High Intensity 
Learning Lab * 



Learning Center C-2 £ 
Hoffaan 

Learning Center 



Learning Center C-3 
Edue. Dev. Lab 



7th, 
Only 



7th - 9th v 



7th'- 9th. 



7th - 9th 



7th - 9th 



7th - 9th 

¥ 




11 ton 



Audubon 



Itxal 



C. $hul^r 



iMooney 



C. Eliot 



lestropp 



Eapire 



FB> ftoos 
-H^Davis 



Roosevelt 



JBGalla 

tHcoln 



allagher 



ipellacy 



/Jfll* King 



MgHerri 
NPrfale 



rrick 



B^ker 



Henry 



amison 



,1 ' 



f/fferson 



* m Young 



bright 



HJ. powells 



ion 



erJc s 



31 



SCHOOL WAS CLOSED IN 3-80 



19 



.11 e 



1 ^ 




APPENDIX B 



Title I Project SJAR Achievement 'Test Results for 
School Years 1977-78 Through 1979-80" 
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Achievement Test Results for'School Years 4 1977-78 through 1979-80 



N0TE\ Th/ following data include only public school participant results. Non- 
public school dalta have yot beejri_ included in the analyses because of the . 
dissimilarity that has existed between the actual instructional sigpport pro- 
vided to pach group. Throughout the three year period Cinder consideration, 
STAR public r school participants have obtained the full-time services of a 
certified project teacher and educational aide/ In the non-public schools, 
however, project instruction has been conductefi^solely by an educational aide-. 
Furthermore, public s<^B§§T participants obtained a minimum of four periods 
(or 3 hrs.) instructional support daily, while the non-public students generally 
received tutorial support only for one period (of"45 minutes) per day. 

\ 

Block'classl and learning center results for the 1979-80 school year should NO? 
be compared because studeifts from both ; groups received different amounts of 
instructional assistance from project personnel (i.e., most block students * 
received five periods of direct project assistance in comparison to only one % 
period of such aid received by j&heir learning center student participant 
counterparts). All block- students, for example, obtained four periods of reading 
and study skills instruction per day for an entire school year. In addition/, 
if scheduling permitted, most of these same students were provided with an extfa* 
period of learning center assistance per day during the year. Learning center 
students, however, received only one period per day of direct project assistance 
during the year. This assistance complemented their one period of regular 
English classroom instruction that was received every day for, the entire year. 
Finally, it is impossible to make such comparisons because there is no way of 
b€ing sure that the same kind of Students were being served by these two types 
of instruction / 
* . / 

As will be demonstrated, the three year summary of STAR achievement results, 
indicate that most of the student groups 7 subtest score gains indicated progress 
which went beyond what normally would be expected if students had not received 
project Jervices. Respite this jkrogr^ss, however, most students continued' to. 
perform at a "belov/average" skills level when their performance was compared 
to the national notm group. These findings suggest that STAR students must 
continue to be pri/ne candidates for additional support assistance. 

Supportive documentation for the findings in this report are on file in the - 
Cleveland Public/ Schools DepartmeTrt of Research, Development and Evaluation^ 
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APPENDIX B-2 

Achigv/ement Test Results for School Years 1977-78 through 1979-80 
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v 

' * 


A : 

»* * 


** 

vocabi^Xry 


> - 






\ 

•* 




Year 


Grade 


Treatment 


Test 

X 


N # 


X Pre NCE 
(Fall Norms) 


X Post NCE . 
(Spring Norms) 


Actual X Gain 


Object. Met* 




t 


1977-78^. 


7 

\ 


Block 


CTBS 
(Form S, 
Level 3) 


276 


28.03 • 


33.90 


5.87 

L 

i 

— ft. p ■ * ■■ 


Yes 


* 


✓ 

* 1 
•~* 

K> 
O 


1978-79 


7 


* 

Block 


CTBS 
(Form S, 
Level 3) 






33.63 


3.30 % . 


No 

• 




1 

\ 


1979-80 


7 


Block 


srftvr 

(Bi>own 
Level) 


354 


28.29 


36.09 


7.80 


\ Yes 


-% - - 





• 


7 


• Learning % 
Cente,r 


SDRT 
(Brown 
Level) 


244 


32.66 


32.65 


-.01 

• 


No 


* 


/ 

117 


\ 

' : 


ft 4 

• 


...... T parniTio 

Center 

<" 


SDRT 
(Brown 
level) 

\, 

« 4 


80 

1 


33". 16 


30.98** 

• 


-2.18 

J 


No 

i 

I" 


/ 

118 ; 

3 



♦Objective Criterion - at least a 4.00 NCE mean gain. i 



**Because Spring norms are not available at the eighth grade level, ninth gr^le Fall norms were used to 
' interpret the eighth grade post scores. 
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*#The samples include only those "students .who received STAR instructional treatment .for a full 



school year. 
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Achievement Test Results for* School Years 1977-78 through 1979'-80 



READING COMPREHENSION 



Year 


Grade 


- 

Treatment , 


Test 


if 


X Pre NCE 
(Fall Norms) 


X Post NCE 
(Spring Norms) 


Actual X Gain 


Object. Met?* 


197^78- 

* 

• 


7 


\ 

Block 


CTBS * 
-(Form S% 
Level 3) 


279 


26.01 
» 


30.99 


r 

. 4,98f 

) 


« 

Yes 


1978-79 


' 7 


Block 
• 


' CTBS 
# (Form S 
Level 3) 


211 


27.56 


' 30.89 


> 

3.33 


• 

No c 


1979-80 


7 


Block 

* 


SDRT 
(Brown ) 
Level) 


336 


26.49 


• 31.54 


5.05 


Yes I r 
• 




7 

V 


Learning 
Center 


'SDRT 
(Brown 
Level ) 


219 

9 


30.12 

* 


31.99 

> 


1.87 


No 

> 




8" 

• 


Learning 
Center 


SDRT 
(Browtf | 
Level) 

\ 


^66 

' 1 

I 

•". 5 


27.56 
■ } 


** 

- 25.-00 

: 


-2.56 


, No 



♦Objective Cfiterion - at le&st a 4.00 NCE mean gain 



**Because Spring norms are noT~£vailable at the' eighth -grade level, Mnth grade Fall norms were rised to 
interpret .the eighty gra<Jeqpost scores. ^/ 

#The samples include only those students- who received VrAR instructional treatment for a full school year. J_20 
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Achievement Test Results for School Years 197f-78 through j 979-80 
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MATHEMATICS COMPUTATION 



I 



121. 



- ■ 

I CclX 


OX oUC 


*• 

Treatment * 


Test 




- X Pre NCp 


X Post NCE 


Actual X Gain 


Object. Met* 












\ 




— v 




1977-78 


7 

* » 


Block 

« 


CTBS 
(Form S, 
Level 5) 


271 

v. 


34.93 


42.38 


7.45 

V. 


Yes 


1978-79 


7 


Block 


' CTBS 
(Form S, 
Level 3) 


233 

f 


36.20 


, 41.36 


^ . 5.16 

i 


Yes ' ' 








** 












1979-jfo 




None' 


None 














i 

1 


i 

N 


• 




/ 


1 
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♦Objective Criterion - at least a 4.00 NCE mean gain .j£ 



#The samples include only those students who received^ STAR instructional treatment for a full school year 
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» 

Achievement Test Results for School Years 1977-78 through 1 979-80 

j z 



EVERYDAY SKILLS (READING) 




1 


Year 


Grade 


Treatment 


Test 




TPre : 
Ravi Score 


X Post 
Raw Score 


■ Actual X Gain 


Object. Met* 




1977-78 


7 „ 


Block 


• 

EST (a) 
(Test A) 


290 


24.08. 


29.30 , 


f\ 

5.55 , 
(t=7.46, 
p< .05) 


* 

Yes 

n 

% 


t 

»— • 
K) 


1978-79 


. 7 


Block 


EST (a) 
(Test A) 


199 


25.91 


29.89 

-* 

% ' 


3.38 • 
(t=4.27, 
,p<.05) 


. Yes 

* 


CW 
1 


i 










» 










1979-80 




v 

Block 


'EST (a) 
(Test A) 


288 


26.32 

r- 


30*27 

i 

t 


3.95 
(t=ll,62, 
P<.05) 

a* 


N 

Yes 


• 




• 




ill 


r 


* 






** 



( a )The Everyday Skills Test {EST) in reading contains a total of 45 items. 
♦Objective Criterion^- significant increase (pl.05) in pre/post EST reading mean raw scores. 
#The samples include only those students who received STAR instructional treatment for a full ^school year. 
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Achievement Test Results for School Years 1977-78 through 1979-80 



J • 

EVERYDAY SKILLS (STUDY SKILLS) 



Year 


Grade 


L 

Treatment . 


• Test 




X Pre NCE 
(Fall Norms) 


X Post NCE 
(6pring Norms) 


Actual X Gain 


Object • Met 


1977-78 r 




Block 


' est( & ) 

(Test B> 


269 

V 


, 19.06,' 

J 


24.68 


5^62 


Yes • 


1978-79 


7 


Block . 


EST 
(Test B) 


197 


19.09 

* 


'21.88 


2.79 

a 


No 

* 


• 

1979-80 


7 

\ 


Block 


EST ( a ) 
(Test B) 


• 

274 


20.99 " 

\ 

— i 


22.01 

■9 

i 


r 

1.02 


< 

No ' v 



# TTie Everyday ♦Skills Test (EST) in Study 9kills contains a total of 50 items, 

* i 

^Objective Criterion - at least a 4. ,00 NCE mean gain. k 

#The .samples dirclude only those-students, who received STAR . instructional treatmeht for a full year* 
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Comparison of Attendance Rates for- 1&79-80 School Year 
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COMPARISON OF ATTENDANCE RATES FOR 1979-80 SCHOOL YEAR 



„3r' 



Block Classes (Grade 7) vs. Tptal Grade 7 



Block Class 
Grade 7 Students 

58 .'8% 



78 . 3% 



Total Grade 7 Block Class (Grade 7) 

Students Minus Total Grade 7 Students 



79.8%» 



79.2% 



- 21.0% 



.9% 



84.8% 



81.7% 



+ 3.1% 



80. ir 



79.7% 



+ .4% 



90. 1% 



71.2% 



J 



86.7% 



76.1% 



+ 3.4% 



+ 1,1% 



78. 43 



86 . 6.3 



80.9% 



81.3% 



2.53 



+ 5.3% 



67.7% 



72.0% 



4.5% 



83.23 



SI. 7% 



+ 1.51 



90.1% 
95.2% 
86.9% 



82.3% 
83.4% 
85.2% 



'+ 7.8% 
+ 11.8% 
+ 1.7% 



79.1% 



80.4% 



81.9% 



80.6% 



2.8% 



.2% 
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■4^.*School 



N 



A. B. Haft 68 
A. Hamiltoi^^ 
Audubon 28 
Central #~ , 

Shuler* 
C. Mooney 

Eliot* 
C. Westropp 
Empire 1 
♦ F.D. Roos.evelt 33 
H. E. Davis 32 



23 

40 
71 



. APPENDIX 

* « 

■ . * * 

COMPARISON OF ATTENDANCE RATES FOR 1979-80 SCHOOL YEAR 
Learning Centers (Grade 7) vs.- Total Grade 7 



Learning Center 
Grade 7 Students 

70.1% 



91 . 6? 



68.4% 

65 . 3% 
69.2% 
75.7% 
77.6% 



Total Grade 7 
Students 

77.5% ■- 



79.8? 



81.7% 

85 . 7% 
79.7% 
86.7% 
76.1% 



Learning Center Grade 7) 
Minus Total G^ade 7 Students' 

- 7.4% • 



+ 11.8% 



- 15.3? 



- 20.4% 

- 10.5% 

- lf.0% 

r* 

+ b. 5% 



Lincoln 
N. Spellacy 
M. L. King 
M. Herri ck 



36 
97 
70 
59 



N. Baker* 

N. Hale 63 

P. Henry 31 

R. Jamison* 

T. Jefferson 42 

W. ,Young*\ 

W.. Wright (a) 

Will son (a) 

TOTALS 693 
f ' 



71 . 5% 
84.2% 
48.3% 
80.7% 

75 . 5% 
74.5% 

72.3% 

* 



75.1% ' 



81,3? 
86.6? 
72.0? 
-72.1? 



$1.7? 



82^% 



83.4? 



80.6? 



- 9.8% 

- 2.4%* 

- 23.7% 
+ 8'. 7% 

- 6.2% 

- 7.8% 

- ir.i% 



- 5.5°i 



* Center established after 5-80 
^ Data unavailable 
O * Center did not serve Gracle 7 students 
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^School 



COMPARISON OF ATTENDANCE RATES FOR 1979-80 SCHOOL YEAR 
'■* Learning Centers (Grade 8) vs. Total Grade 8 



A. B...Tiart 
A. Hamilton* 
Audubon (a) 
Central # 
C. Shuler* 
C. Mooney 
C. Eliot* 



C. Westropp 




Learning Center 
grade 8 Students 

47.4% 



Total Grade 8' 
Students 



Learning Center Grade 8 ) 
Minus Total Grade 8 Students 



74.3% 



13 
17 



Empire 
F.D. Roosevelt 54 
H. E. Davis 28 



47.0% 

50.1% 
81.5% 
64.4% 
59.6% 



80.8% 

81.1% 
76.0% 
83.8% 
73:1% 



26.93 



- 33.8% 

- 31.0% 
+ 5.5% 

- 19.-4% 

- 13.5% 



Lincoln 


45 


69.4% 




81.0% 




- 11.6% 


M. Spellacy 


25 


76.2%* 


t 


86.7% 




- 10.5%. 


M. L. King 
M. Herrick ' 


35 

J 


38.5% 
60.3% 




69.1% 
* 73.5%* 




- 30.6% v * 

- 13.2% 


N. Baker* 










? 


N. Hale 
P. Hpnry 


50 

101- 


77.5% 
75.7% 


S 


80.2% 
80.7% . 

• 




-i 2.7% 

- 5.0% 


R. Jamison* 






*> 

< 








T. Jefferson 


12 


52.7% 




79.7% ' 


/ 


- 27.0% 


W. Young* 








-» 


' ! 




J»f Wright J 


u8 


86.7% 


7 


83.3% 




+ 3.4% 


Willson- 
TOTALS 


25 
437 


76.5%- , 
*» 69 ' 5% 




81.8% ^£ 
79.4% 




- 5.3% 

- 9.9% 



# Data unavailable 
X«) Center did not serve Grade 7 students 



v 
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CLEVELAND PUBLIC SCHOOLS 

Division of Research and Development 

July, 1980 

APPENDIX D 
1979-80 TItJe I PROJECT STAR CLASSES 

\ 

. Survey of Project Teachers 
SCHOOL Summary of All Schools ' DATE July, 1980 



v 



TEACHING ASSIGNMENT ' 

T 

Please indicate your current teaching assignment by placing a "X" in froijt 
of the description which. applies. ■ . 

10 'Block English 14 Learning Center A 

10 Block ^Jfel Studies 4 Learning Center B 

4 Learning Center C 

PROJECT OPERATIONS 

a. Did this year's work stoppage create problems, which affected the 
implementatioprof project activities within your school? 

• Yes 20% No 62% • No Response 9% m 

. If "Yes", describe how the project activities were affected. 

Lengthened year caused attendance and motivational problems in lat e 

June and July, ..Children were resentful being in school beyond norm al 

. closing dates. 

b. Did you encounter difficulty scheduling students into your Project 
STAR classes? 

I 

Yes 57% \ No 40% ^ No Response 1% 

. If "Yes", 'describe the difficulties you experienced. _j 



Students who were assigned to study halls were, in many cases, not 

there because of schedule changes. ( ^ 

How were the difficulties listed above resolved? 

Schedule chan ges were worked out with guidance persons, b>r£ < ^the s> i^fi g 
wait for fhc^se changes were very difficult for teache/^and students. 
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APPENDIX D-2 



c. Did you find it necessary to make adjustments in your teaching as a 
result of the greater heterogenous racial composition of students 
wjlthin your STAR classes? • % 

/ Yes 19% No\ 79% ■ No Response 2% 

• If "Yes", briefly describe nature of the adjustments that were 

made in your teaching. 
* 

' Had to be much more aware of student interaction. Had to con- 

" * ! " 

/ centrate on breaking down racial barriers; 



FOR BLOCK TEACHERS ONLY 



How would you rate the, value of the following operational features 
of the project in terms of promoting student learning? 

\}j^ch * Some 
Essential ^alue Value 



Double period of English 
and social studies ' 

Block teacher's presence 
in* the vocational education 
classroom— % 

Variations in second period 
of the students' block 
schedule (i.e., English - 
reading lab participation, 
social studies resource 
teacher assistance) 

Meetings h£ld .with your 
STAR team (i/^v involving 
the block teacher^jresource 
teachers and aide) 



45% 



10% 



Little or No 
No Value Response 



20% 



35% 



15% 



35% 



45% .253 



20% 35% 



15% 



35? 



30% 



5% 



-2% 



5% 
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APPENDIX D-3 



FOR LEARNING CENTER TEACHERS ONLY 



• A. 



/ 



1 \ 

e. Do you foresee a need to establish a closer cooperatiye relationship \ 
with DPPF Communication Skills senior high School reading ^/teachers? 



Yes 41% 



•No 41% 



Nov Response 18% J 



If "Yes", \n what areas should such cooperation" be established? 
It might help if" they had advance in/fo on-students who still' nee d 
remedial work and to have som e ingut on 4*hat student has accom- 
plished and still needs . 



3. EDUCATIONAL AIDE 

How adequate were the supportive/senrices^proyidecLby your aide? Indicate 
your response by placing a checK in the column which most closely 



corresponds to your opinion. 



Ability^to do assigned work 
Willingness to do assigned work 
Quality of actual job performance 

Comments: My aide was "one of ttye reason that this was a very productive and 



1 

Mor$ Than 
Adequate 


Adequate 


Less Than 
Adequate 


No ( ■ 
Response 


7 57%- 


21% 


'17% 


5% 


T ; _ 

' 56^ 


~ 29% 


. 10% 




. 50% 


- 31% . 


' 14% 


5% 



enriching year for me as well ftg the students. 



4. INSTRUCTIONAL AIDjS 

Instructional materials ^nd supplies (books, workvsupplies, etc.) provided - 
by the project are: / / 



Appropriate to the learning levels of project 
students 

Useful in achievip£ pro^ctyibjejctiyes * 



Yes 


. No 


No Response 


90% 


2% 


8% 


90% 


2% " 


8% 
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> A, 



INST RtftSHONAL AIDS - continued, 

V 



Relevant to the interests of project 
students 



Yes 


. No 


No Response 


88% 


• 5% , 


* n 


\81% 


7% 


" 12% 



Adequate in quantity / 

7 • \ * 

Comments: The materials and supplies made it possible to cover a wide 
rdnge of s kills ^fat students need throughout' their lives . 



ATTITUDES OF FACULTY 

In your opirfion, what value does the faculty members in your building, 
place on Project STAR'S efforts to improve student reading? 

26% Essential , m. 



. 24% Much Value 

* * 29% Somp Value 

A 10% Little or No Value 




m / 11% No Response 
Comments: * 



thout block class not enough teachers knew or cared abotft Project STAR 

at Herri ck. l/ 

PROJECT INSERVICE EFFECTIVENESS <* 

a. Please indicate the total number of project spdnsored inservice „ 
meetings which you attended- this year* * 

' 4 Total number of project * inservice. 

sessions which I attended this year. 

b. In terms of your own classroom instructional needs, how helpful did you . ^ 
m find the information, that was preSerited at Ptoject STAR inservice 

sessions held throughout the year? 

Very * Somewhat - Not - No c 

48% Helpful 26% Helpful 19% Helpful * Helpful 7% R esponse 

c. To what extent did your classroom instructional approach cha nge a s a ^ v 
result of attending these project sponsored inservice sessioil^*. \ 

f - , -No. 

- 14% Alot / 60% Some 19% Not Much None 7% Response 
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6 . PROJECT INSERVICE EFFECTIVENESS - continued ' 

r ' ' 

dy In planning for inservice next year, what recommendation would you 
make regarding each of the items listed below? 



• A 

Numbe^W-^essions offered * 
Variet^sgif topics 
Time spent presenting each topic 
Sessions that provide suggestive 
* teaching strategies • < 



Increase 



26% 



49% 



24% 



Continue 
As' Is 

54% 

; 38% 

52% 



Decrease 



10? 



2% 



'No 
Response 

' 10% 
11% ' 
17% 



20% 



Please describe additional inservice recommendations you would like to see acte4 
upon. 

« 

Use more of the meeting time actually doing something that will h&j our teaching . 

Too much time is spent talking and gripingf^'ggout^problems - set that aside in its 
owntimg period. ' * 




7. PROJECT EFFECTIVENESS . 

a*. In your opinion, what single feature of the project has contributed 
most to classroom effectiveness (in terms of improving pupils' _ 
learning)? # . 9 

Double period of English, . .Ability to totally individualize. . . 



\ 



Individualized instruction, opportunity to pace students according 

to their negds. 

b. In your opinion, what single factor has been most detrimental (or 
* contributed lea§t)*to pupils' learning? ^ 

Poor student attendance* Lack of motivation due to^ length of school 
year ,..Need for report ,card grades and computer scheduling. * .The pro - 
cess 6f having to pull Learning Center candidates from study hall is 
detrementai . ' "* ~ 

c* What changes would you recommend be made -in the project to improve the 

' services offered to students? 

Coryect, on-time ^computer lists of eligible students . ..Learning Cent er 
candidates shouls be programmed into the Centers. [ 
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PROJECT EFFECTIVENESS - continued 

d« ' Record any additional comments you feel need to be made relative to the 
'operations of the project. , 

, The lack of an "official" grade caused stuc^nts co see project as 

somewhat unimportant. Can points for STAR be included in officia l 

point average? .The Century 21 pro grain is a n effective program ^s 

" far as it goes. Somewhere along the line the program materials 

should be supplemented with increased vocabulaV^mfrterial to impro ve 

4 

the reading and meaning vocabulary base of the majority of student s 
that concl ude the "Codebuster" segment of W:he program. If it is n ot 
supplemented with programmed material, a way should be provided fo r 
teacher provided vocabulary, improvement work or exercises. ^_ 



\ 
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PUPIL ADJUSTMENT PROJECT 



Prepared by 

Dr. Reba Garvey 
Research Associate 



Typed by 
Trina Beard 



Margaret Fleming 
Dbputy Superintendent 



1979-1980 



A 



PUPIL ADJUSTMENT PROJECT 
197*9-80 Title I Evaluation / 



PURPOSE AND OVERVIEW 



The purpose of : P*P (Pupil Adjustment Project) is to develop basic 
social ani academic skills among four-to-six-year-old kindergarten pupils 
' exhibitingtoecial needs (but not identified as LD or EMR).. The basic cri- 
terion for Eligibility is scoring at or below the 33rd %-ile (fall, kinder- 
garten, national norms) on TOBE General Concepts, Level K. With priority 
given to the lowest-scoring, assignment to project services is contingent 
upon parental consent and based on instructional/supportive services/admin- 
istrative team recommendation. 

* * 

PAP features: sttpplementary instruction based on pupils' unique 
'needs and'learnirtg styles; interdisciplinary supportive services; special- 
ized staff 4jeVeiopment . » The highly individualized instructional model in- 
volves extensive diagnosis and strong emphasis on language development. 

PAP services are provided' in three formats (intensities) . Chil- 
dren enrolled in r a Comprehensive Center (class of 10-120 are transported 
from and to home daily; 'they 'receive a half-day supplementary instruction 
along with, and in ^addition to, regular .(general fund) half-day kindergar- 
ten-totaling a full day. Other pupils are transported from their home- 
school kindergartens to one of the Adjustment Centers where, m a group of 
10-15 children^from several schools, they receive approximately two hours 
of special instruction* daily (before being transported back to their home- 
school kindergartens for the remainder, of the session) . Still other chil- 
dren are served at their home^schools by a Traveling Teacher, who works 
with themfcn a "pull out" basis fer about. an hour, three times a week. 



SERVICE SUMMARY 

Number of Pupils Served : 18^ JSrade Served : Kd S' 



Number of Schools; 57 (See Appendix A. ft Years- in Operation : 12 



Staffing : 1 Consultant Teacher: Project 12 Teachers (7 FT, 5 PT) 

Manager (FT) 11 Educational Aides (FT) 

'2 Psychologists (PT) 1 Clerk (FT) 

* • 2 Speech Therapists (FT) 6 Drivers (5 FT, 1 PT) 
-1 Social Worker (FT) 



total Title -I Expenditures : $576,953 - Per Pupil Cost : $3,188* 

*The per-pupil cost represents only Title I expenditures, which were in 
addition to general fund support. • • 
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OBJECTIVES AND OUTCOMES 

+ 

• Process Objective 1 : For the self-contained Comprehensive Centers, 
* placement of 4-to-6 year-old. children will be made on or before 
November 1/1979. 

. Outpoye: This objective was attained. Lists submitted to the 
evaluator and records on file with the project manager documented 
m ' that approximately three fourths of the children in Comprehensive 
Centers were enrolled by ^jlate September--thus priQr to November 1. 

. Process O bjective 2 : ^Eligible children will be admitted to Adjustment 
. Centers or assigned to a traveling teacher at any time during the- 
year, as special identification procedure's are completed and need 
arises. \ / 

. Outcome: This objective was attained. Lists submitted to the t • 
evaluator showed from one to twelve children enrolled monthly in 
Adjustment Centers or with traveling teachers, -from, November v 
through June (except for December). Forty-four (39.3%) of the 112 
children receiving these types of project service began after the 
initial (October) enrollment period.' 

. Process Objective 3: Criteria for accepting pupils from regular 
Early Childhood Education classes into Adjustment Centers and for re- 
turning these same childrei) to their respective regular classes- -de- 
veloped and piloted during the 1978-1979 school year--will be re- 
evaluated • 1 

0 

. Outcome : Available information implied attainment of this objec- 
* tive. 

Basic criteria for project eligibility remained those established 
for Title I. The "criteria** referenced here were those incorpo- 
rated into the extensive diagnostic/referral procedures involved 
in assessing each child*s needs and in a team's deciding ilpon the 
type of PAP service, li: any, most suitable/feasible for that pu- 
pil. d - 

* 

Informal conversations/observations and project reports/documents 
indicated that, as project instructional/supportive services/ 
■ administrative teams met regularly throughout the year and' as PAP 
staff met frequently with other Early ChildhooSf and 'non-project 
personnel, these criteria (i^.^e . , diagnostic /referral procedures) 
were continually evaluated, or field-tested. 

In June, 1980 teachers and aides with (DPPF) Kindergarten Rein- 
forcement and (Title I) Child Development—as weld as PAP--com- 
pleted a Classroom Staff Survay. Responses of PAP teachers andr 
aides have been included as Appendices B and C, respectively. Two 
items (9-a and -b) pertained to the u^fulness/helpfulness of the 
PAP diagnostic/referral instruments . ^>st Kindergarten Reinforce- 
ment (87.7%) and Child Development (56.2%) teachers marking these 
items indicated tjiat th£y„used PAP referral instruraehts at least 
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"occasionally." Only one teacher from each of these projects 
indicated that the 'instruments were "too cumbersome,"- and most 
(75.1% of . f Child Development, 89.5% of Kindergarten Reinforcement) 
rated them of "some /little help" or better. f 

Process 'Objective 4 : Project and regular classroom teachers will be 
involved in planning and developing an instructional program which 
will respond to the needs of children in the following areas: 

.j communication skills adequate for listening to and expressing 
feelings, needs and ideas; 

sensory-motor skills for development of control of the body in 
the environment; 

* • • 

. development of self-esteem and self-confidence* through successful 
experiences; 

sensory discrimination for development of awareness of and sensi- 
tivity to the environment. 

* j> 
. . Outcome : This objective was attained. Pertinent evidence compiled 
from project records/documents as well as teachers' responses (N = 
12) to the staff survey (Appendix B) indicated that PAP and regular 
teachers were mutually involved in instructional planning for chil- 
dren. * * 

On September 5, 1979 PAP and Kindergarten Reinforcement staff met 
together for basic planning. A September 21 memorandum alerted 
principals to the fact that PAP Adjustment and traveling teachers 
wild be meeting with children's home-school teachers and observ- • 
. ing pupils in the regular classrooms. Subsequent bulletins and 
memoranda Ce.JL. , January 22, February 5, April 8, May 21, 1980) -re- 
minded PAP staff about .maintaining contact with children's home- 
school teachers/administrators and continuity in pupils' programs. 

All project teachers responding to the %urvrey indicated having 
consulted with "other Early "Childhood teacher(sT and/or teacher 
assistant(s)" about at least "2-3" children— the majority (58.3%) 
about "all" their pupils. Similarly, all teachers had consulted 
with the principal about at least one<child--41.7% about all 
^JCpil-s. 

Teachers' survey responses, relevant to the adequacy of their re- 
cords of children's progress in four areas (Appendix B, Item 8) * 
were expected to reflect their recognition of pupils' needs in 
their instructional planning. Teachers wete asked to describe 
their records in each area as "nonexistent," "sketchy, unsystem- 
atic,", "detailed for oijly a*few," "somewhat Retailed for all," 
V'quitejietailed for many," or "very detailed for all." Per- - 
centages of teachers selecting descript&rs of "detailed for only 
a few" of better ranged from 75% iru the psychomotor area to al- 
most 92% in language and other cognitive areas. Records were^ 
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reported "very detailed for all 11 pupils by 25% of the teachers 
for social-emotional and psychomotor areas, 58.3% for language 
and 66.7% for "other cognitive areas. 11 

• «- 

Process Objective 5 : In 'addition to regular inservice meetings held 
by the Division of Early Childhood Education,] specialized staff de- 
velopment will be conducted in groups — and, as indicated, individual ly-« 
to facilitate attainment of project goals. Sessions will deal with 
such topics as: individualizing the instructional plan based on ♦as- 
sessed needs; systematically observing and 9 recording child behavior; 
cognitive mapping [preferred ^learning behaviorsj; developing curri- 
culum appropriate to varied needs [and learning styles} of pupils. 

. Outcome : This objective was attained. Evidence was compiled 

from project records/documents as well as responses to the class-' 
room staff survey complied by project teachers and aides. (As 
noted above, summaries of staff -survey responses have been in- 
cluded as Appendices B and C.) 



Coverage' of the four proposed topics and some differentiation be- 
tween teachers and aides (specialization) were refleated in re- 
sponses to Item 3 in the staff -survey. Teachers and aides were 
aslted to indicate for each of seven activities—consonant with the 
foiir topics'^-the extent. to which that activity had been emphasized 
infinservice. They were instructed to mark: "never, 11 "once-iwice, 11 
"ndw and then, 11 "often 11 or, "every time. 11 All respondents indicated 
that "understanding language development" and "facilitating lan- __ 
guige srowth" were emphasized "oftpn" or "every time," in keeping 
with the proposed emphasis on communications skills (Process Objec- 
tive 4). Two-thirds of the teachers and 77.8% of the^.aides reported 
that ''observing behavior" was emphasized '"of ten 11 or "every time," 
and] two-thirds of both teachers and aides indicated similar empha- 
sis! on "recording observations." 'Most teachers marked "often" <or 
"every time" for "analyzing assessment data" (83.3%); "prestribing 
instruction 11 (83.3%) and "implementing prescriptions" (100.0%), 
whijLe fewer aides noted as much emphasis: "analyzing..." (44.4%), 
"prescribing..." (0.0%), and 'implementing..." (77.7%),. These sur- 
veylresults documented inservice coverage of the proposed topics 
in a differentiated specialized) fashion. _ 

Specialization of staff ^development was further verified by the ' 
project manager's reports and various other project documents filed 
with the evaluator. Managers reports covering approximately 21 
weeks pf> school (mid-September through early May) listed 51 staff 
development occurrences —averaging 2.4 per week. These included a 
variety of individual and group events: project team meetings (in- 
structional and supportive staff serving each center); meetings of 
project .staff with kindergarten personnel; total project staff 
workshops (assessment, etc*) as well as separate sessions for com- 
prehensive center, adjustment center and traveling personnel; ori- 
entation meetings for teachers and for aides new to the project; 
participation of a project representative in citywide and state 
(Title I) meetings; etc. c * > ^ 

* 
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Also.,- individualized* staff development for project teachers and 
aides was provided on an ongoing basis by the project manager 
through on-site visits to centers* All but one of the teachers 
and aides reported having been visited at least once, most— half 
fhe teachers and 66.4% of the aides— four or more times. Most 
083.3%) of the teachers and 66.7% of the aides reported a post- 
observation conference/discussion on at least one occasion, appro- 
ximately one-fourth on four or more occasions. 

* 

"Process Ob-jective 6 : Special* staff inservice will be conducted with 
the assistance of consultants from the University of Illinoisjrele- 
vant to utilization of PEEC (Precise Early Education for Children). 

A 

. Selected staff will attend sessions at the University. 

. On-site development will be provided to PAP as a service of the 
PEEC replication program. 

* * ■ 

. Techniques and findings will be shared in dissemination sessions 
with the total project CPAP3 staff. ' . * , 

. Outcome : Two of three types of activities proposed with this 
objective were implemented during 1979-1980. Thus, the objective 
was partially attained. 

• During 1979-19$0 the Pupil Adjustment <Project continued its in- 
volvement tfith the PEEC replication program. (PEEC, developed 
at the University of Illinois under the direction of Dr.Tterle 
6. Karnes, .represents an extensive plan for systematically imple- 
menting highly individualized educational programming for pre- 
school children.) The Comprehensive Center at Wade Park School 
and the Adjustment Center at Charles W. Chesnutt School were 
'* selected as the 1979-1980 replication sites. 

Although it was not possible fpr PAP staff to attend PEEC sessions 
at the University of Illinois, PEEC did provide on-site staff de- 
velopment and PEEC techniques/findings were disseminated to the total 
' PAP staff, as proposed. A PEEC workshop for project staff involved 
in replication was held on October 16, 1979. On June 13, 1980 Anna 
Kokotovich, from the University, was the major presenter at another- 
PAP inservice workshop; project records indicated that PEEC proce- 
dures/materials were being disseminated on an ongcing basis. 



Process Oh-iective 7 : Staff case conferences £i.e. , team meetings! will 
be scheduled regularly to discuss selected children among instructional 
staff and representatives of supportive services-social work, .special 
services (parent involvement), psychology, speech therapy, nursing . 

. Outcome : Project records indicated that this objective was achieved. 
Series of team meetings (one at each Comprehensive/Adjustment Center) 
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were held during mid-September, fate-February/early-March, and 
mid-June. Adjustment Center teams had at least one additional 
> meeting in May, , * * 

Instruct iona;i staff contacts with supportive staff were not, how- 
. ever, limited to teim meetings. On the June, 1980 staff survey 
teachers and aides marked "none," "one, 11 "2-3," "several l,% or "all" 
to report "about how many of your pupils have you consulted this 
♦year with" several kinds of supportive services personnel v (Item. 1) . 
A clear majority of project teachers marked "several lf *or "all" 
pupils for the Early Childhood Education psychologists (83.3%), 
social worker (91.7%) and speech therapist (75.0%) as well as 
for the non-project school nurse (75.0%). (Aides reported fewer 
contacts with supportive sfervices staff about pupils.) 

- 

Process Objective 8: Involvement of parents with the learning ex- 
periences of their children will be continued through: 

"* ^ 
. scheduling periodic parent -group meetings and parent educational 
programs ; ' * 

/ dissemination of, information through The Bridge (newsletter for 
parents of children in Early Childhood Education); 

. encouragement of pa^ent^onferences and meetings with staff; 

. prqmotion of parent visits to the Parent Resource Center as well as 
the classroom; . * * 

. integration of parents t opinions and suggestions into program opera 
tions, whenever possible. 

Outcome: Efforts lx> promote parent involvement were continued, as 
proposed. Project reports, 'records, etc. indicated that this ob- 
jective was attained. 

♦ 

The importance of active 'parent involvement in their children's 
. education was emphasized throughout the year— in oraJ..and written 
" communications with project and non-project staff, as well as 
parents themselves. Parent consent was required for.pjdpil parti- 
cipation in the project, and. the project manager's annual summary 
reported an "estimated unduplicated count" of 271, parents involved 
in some way during the year. 

Three issues of The Bridge (February, May, July, 1980) were sent 
home with the children. In every issue parent involvement was both 
encouraged and recognized. Parents were invited to use the sharing 
(resource), center(s) . (At the west-side center, material for pa- 
rents to borrow -for providing home -reinforcement of school instruc- 
# tion was available in*both Spanish and English.) In Xhe B ridge 
and in person, they were encouraged to attend and participate in 
the annual (February 20, 1980* citywide N tosgJ ing of Early Childhood 
Barents with the Directing Supervisor of Compensatbry Education 



.144- 1*3 



/ 

/ 
/ 



programs. On March 19^ 1980 TAP and other Early Childhood parents 
participated in the Cleveland Pilblic Library funded program fea- 
turing "Augusta Baker, nationally knoym children's author and ^tory- 
teller. Jheir attention was called to a seven-installment series 
on parenting ("Look At Me") available yia public television /begin- 
ning May 24, 1980. Parent use of project, school and community re- 
sources-was continually advanced through The- Bridge and person-to- .\ 
person contacts. 

Although parent involvement with citywide activities such as those 'j 
just mentioned was promoted, project staff put forth even greater J 
efforts to involve pargnts at the local school level --as classrobm 
volunteers, as well as ^observers of their children "at work." Pa- 
rents were always welcome and four tifiies a year special observation 
d^ys/yeeks were scheduled, with parent-staff' discussion meetings 
held after classroom observation. The manager reported a' tiotal or 
244 parent-attendances at group meetings and 694 for individual con- 
ferences. ~ , 

"Responses to the June/ 1980 classroom staff survey (summarized in 
Appendices B and C) shed additional light on the extent and types 
of parent involvement. Teachers and assistants were asked (Item 
2 -a) to indicate how m^ny pupils 1 , parents were involved in eight 
activities, by marking^ "none," "1-2;" "several," "about half" or 
"all." Half (50.0%) the teachers indicated that a parent or family 
representative of all their pupils had conferred with them at least 
once since the intake interview*; another 41.7% of the teachers in- 
dicated that thisVas<the case for "about half" their children. 
Teachers and aides (66\7%) reported conferring "as often as once a 
month" with parent(s) # of "1-2" or "several" pupils. Most teachers 
indicated that parentis) of "several" or "about half" the children 
"attended at least one school-wide parent meetjLng , _|_(67.6%) and that 
a, family representative of "1-2" or "several" attended at least one / 
"project /Early Childhood special program" (66.7%). Responses to re- / 
maining activities listed with t\\is item (2-a) suggested- that, al- 
though /nost children f s parents did come at least once to observe in 
a v projdct classroom and most did respond to" telephone calls/i,nvita- 
. tions^only a* few borrowed materials for helping the child at home 
or "worked on a reguldr basis as a volunteer" in the classroom, 




A community outreach, dental services pilot ^project was implemented 
jointly by the Cleveland Public Schools and the Psi Omega dental 
fraternity of Cas<e Western Reserve University Dental School. All 
PAP centers were scheduled for the dental 'health lessons, screening 
and referral services provided by three tefams of two dental students 
(one senior, one sophomore). A total of 104 PAP children were 
screened and 19 were referred for treatment. Parents were invited, 
to be present when their children were screened and, thus, be made 
more aware of the importance of dental health* „ 
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♦ — Performance Object-ive-4 ; Project children served for a period of at 
least nine weeks will show a mean gain of at least four NCE units on 
the TOBE Language and Mathematics tests, administered on a pre-post - 
service basis. 

. Out come : This objective was attained in Language and, by children 
at the Comprehensive Centers only, in Mathematics. Results of pre- 
post administration of TOBE have, been summarized in Appendix D. 

Publishers (national) norms were' utilized in the data analysis — 
prekindergarten for pre-tests and kindergarten for post -test. 
Mean pre-post gains in TOBE Language were: 16.3 NQE's for Compre- 
hensive Center pupils, 6.6 NCE's for Adjustment Center Children 
and 6.8 NCE f s for those assisted by a traveling teacher. On TOBE 
Mathematics, the mean gain for Comprehensive Center children was 
5.1 NCE junits. Average* mathematics c hanges ^were +1.4 NCE's for 
Adjustment Center and -4.2 NCE's for tfaveliii^ teachers 1 children. 



Performa nce Objective 2: ^Project children at a Comprehensive Center 
will show a significantly (p<.05) higher level of social competency 
skills at the end of the year, based on teachers 1 pre-post ratings on 
the Levine-Elzey Preschool Social Competency Scale. 

. Outcome: This objective was attained. Data for 1979-1970 have 
been presented. in Appendix E (along with those for the previous 
two years) . 

Teachers 1 October^nd May ratings of the Comprehensive Center Chil- 
dren were scoredffor four factors: Self-sufficiency, Emotional Ma- 
turity, Social^ Skills and Self-concept. Application of the t-test 
to these data/ revealed significant (p^.001) gains in all four 
areas. 



ADDITIONAL FINDINGS 

Although not specifically pertinent to any one objective, data on 
the Fall*, 1980 placement j>? 1979-198*0 PAP children was complied. 'Also, PAP 
pupils 1 scores on the ^Metropolitan Readiness Tests, Level II, Form P (admi- 
nistered citywide to kindergarten children in May, 1980) were analyzed. 
Findings have been summarized below. 

• • FalK 1980 Placement : Twelve types of Fall placement were reported 

for the 181 childrert served. Seventy-three children (40.3%) were 
enrolled in first grade. Forty-eight pupils (26.5%) remained as- 
signed to PAP Comprehensive or Adjustment Centers, and one child's 
placement was kindergarten. Smaller percentages of pupils were 
enrolled in Learning Disabilities classes (13.34) and various EMR . 
programs (19.9%) . 

♦ Metropolitan Readiness Tests ; Pupil Adjustment children expected to 
be enrolled in first-grade in # the Fall of 1980 completed the Metro- 
politan Readiness Tests during the late-May citywide administration, 
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and their results were compiled and compared with those for other- 
kindergarten children in Title I schools* On the Pre-reading 
t Skills Composite, there was no significant difference between the 
^ PAP and ,other Title I kindergarteners. Qn the Quantitative Skill 

Area, the mean score for PAP children was^slight ly, but signifi- 
cantly, lower, as shown in Appendix-F. v 

SUMMARY AND CONCLUSIONS - 

The 1979.-J.980 school year jw€f£"replete with unique and unpredict- 

, able events affecting -all project operations, tyost notable were the lengthy 

work stoppage (which resulted in sdhools 1 being closed from November 7, 1979 

until January 4,- 1980) and court -ordered desegregation—implementation of 

Phase I (Fall, 1979) and Phase II march 17, 1980); preparations for Phase 

III implementation (Fall, 1980). Despite these conditions, seven (of eight) 

process objectives were attained, *and the eighth was partially attained. 
*f ' 

In relation to the _first performance objective, data were analyzed 
as proposed and showed that this objective had been partially attained--in 
both Language and Mathematics at Comprehensive Centers, and in Language only 
by pupils at Adjustment Centers or with traveling teachers. These results 
were obtained despite the fact that this evaluation was based on' approxi- 
mately six fewer weeks of project service to children than in previous 
years. The larger gains in Language seemed to reflect the high priority 
placed on language development and communications skills in this project and 
all E#rly Childhood Education programs. The greater gains at Comprehensive 
Centers may have been due to the fact that these children received full -day 
(rather than half-day) -instruction/ Analysis of the pre-post results on 
the Levine-Elzey Scale indicated that the Comprehensive Center children had 
shown significant growth in* all areas of social competency, as proposed. 

Findings for 1979-1980 and previous years suggest that the project 
staff should: 

. continue to refine procedures for delivery of highly individ- 

dualized project services to children, weighing possibilities / 
for : 

/. inclf%ased utilization of thejnore effective Comprehensive 
-' Center format, and > ' 

. improved cost effectiveness; 

. consider revisions in objectives , fewer process objec- 

tives, with more specific criteria; objective relevant to post- 
PAP placement of pupils); 

. plan with the eValuator for systematic collection of feedback 
from parents ; • 

. replace the (out-of-print) T0BE with appropriate instruments 
for assessing eligibility and progress in cognitive areas. 
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APPENDIX A 
PUPIL ADJUSTMENT PROJECT 
SCHOOLS SERVED; 1979-1980* 



Affrfed A. ^Benesch 
Andrew J. Rickoff 
Anthony Wayne 
Anton Grdina 
Bolton 

Boulevard 

Buc key e -Wo o d 1 and 

Buhrer 

Captain Arthur Roth 
Case 

Charles Dickens* 
Charles H. Lake (A) 
Charles W. Chesnutt- (A) 
Daniel E. Morgan 
Dike 



Do an 
East Clark 
East Madison 
Forest Hill Parkway (A) 
George W. Carver (C,A) 

Giddings 

Gordon 

•Hazeldell 

Hicks 

Hodge 

Iowa-Maple 
John D. Rockefeller 
John W . Raper (A) 
Joseph, F. Landis 



Kenneth W. Clement 
Kentucky . 
Lafayette . 
Lawn 

Longwood 

Louis' Pasteur (C) 
Margaret A. Ireland 
Marion -Sterling 
Mary B^. Martin 
Mary M. Bethune 
L 

Miles_Park 
-files Standish 
rtoses Cleaveland * 
Mount ^Auburn 
Mount Pleasant 

Orchard" (A) * 
Paul L. Dunbar (C) 
Paul Revere 
Robert Fulton (C) 
Scran ton 

Sowinski 

Stephen E. Howe 

Tremont 

Wade Park' (C)" 

Walton- 

Watterson-Lake ' ^ 

Waverly 

Willow - 



C=Comprehensive Center; A=Adjustment Center (Other 'schools 
transported to an Adjustment Center or served by a Traveling 
Teacher.) ***** 
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APPENDIX B 

EARLY CHILDHOOD EDUCATION CLASSROOM StAFF SURVEY: \JUNE, 1980 
PUPIL ADJUSTMENT PROJECT TEACHERS* (N=12) 



i/ihzAz comments ok zxplanationA ate cu>kzd, pizcuz pnint ok mitz 
vzsiy izgibZy,- tiling only thz 'apace plovided. » kll othvi KZApon6&> 
6houid be ixdicatzd by maAking JLin thz appKopKLatz box ion. zach 
i£m. U&z a baJU-peint ok n ¥laOi n pw, ok a thaAp, dank pzncil. 




1. 



-V**/«; 
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s PER CENT 

(Ue #i£4e heading* to indicate, the. 
About how many of your pubils Jj^«7\ nt/mbe/i pupils £oK eacii -Ate/n. 
you -consulted this year with: 

none 

. other Early Childhood teacher(s) 
* and/or teacher assistant (s) ? . . f (01) . 0.0 

. first-gTade teacher(s)? (02)* 50.0 

. principal? . .' (03) 0.0 

. Early Childhood supportive services: 

. consult, tchr. /.reading spec? (04) 0.0 

. psychologist? . (05) 8.3 

. social worker? (06) 0.0 

7 speech therapist? (07)^ 0.0 

. school's "regular" support staff: 

\. nurse? (08) 0.0 

. psychologist? (09) 75.0 

. speech therapist? (10} 58.3 

. community agencies? (11) 33.3 

\ 

. parent/family representative ... (12) 8.3 



one 


2 


-3 


several 


all* 


OMIT 


0.0 


25 


.0 


16 


.7 


58.3 


















41.7 


0 


.0 


0 


.0 


8.3 


0.0 


16.7 


25 


.0 


16 


.7 


41.7 


0.0 


8.3 


16 


.7 


0 


.0 


75.0 


0.0 


8.3 


0 


.0 


8 


.3 


75.0 


0.0 


8.3 


0 


.0 


0 


!o 


91.7 


0.0 


16.7 


8 


.3 


8 


.3' 


66.7 


0.0 


/ 














8,3 


16 


.7 


8 


.3 


66.7 


5.0 


8.3 


t 

.8 


.3 


• ,8 


.3 


0.0 


0.0 


25.0 


16 


.7 


0 


.0 


0.0. 


0.0 


25.0 


33 


.3 


8 


.3 


0.0 


0.0 


16.7 


0 


.0 


16 


.7 


50.0 


8.3 



other--Ide*tif>\ 



XT 



2-a. 



For approximately how many pt jpils 
this year has a parent or other 
family representative*: 

, conferred with you at least one 
(other than 'fin^akoV 1 etc.)'? » 



conferred with you as often 
as once a month? (14) 



\ 



lUz tliziz kzading& to indicatz the, 
ntmboA o£ p'apiU fioK zacli itm. 

1-2 several jjjft^al! OMIT 

0.0 8.3> 41.7 50.0 0.0 

33.3 33%3 16.7 8.3 0.0 




'[continued) 
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APPENDIX B CCont'd) 




none 



attended at least one ■ 
school-wide parent meeting? 



1-2 several aoout all 
half 



OMKT 



(XSi 0.0 1 33.3 jSO.O 16.7 0.0 0.6 

8.3 

(17) 2^.0 50.0 : 16.7. 0.0 0t0 8.3 

(18) 0.0 • 0.0 16.7 41.7 33.3$ 8.3 

(19) 33. 3, 58.3 0.0 0.0 0.0 8.3 



attended at least one project/ / 

Early Childhood special program? (16) 8.3 33."3 33.3 hO.O 16.7 

borrowed materials to use 
with child(rejy at home? 

Visited, in your classroom at 
least "once, to observe? \ , 

worked on a regular basis as a 
volunteer in; your classrooqi ., 



. never "returned to call," responded 
to an invitation, etc.? (20) 41.7 33.3/ 16.7 8.3 0.0 

b. Describe briefly youjr m$$X strategy this year for increasing parent involvement 
in children's education, Especially by providing reiiifofrcement duringSkt-of- 
school hours/days .*/ \ ™ 



To the^ right of each activity listed, 
mark^one box to indicate the extent , 
to which that activity- -involved in 
the individualization of instruction-- 
was emphasized in inservice this year * 
(individual, small-group, project-wide). 

. observing behavior (21) 

. recording observations (22) 

analyzing assessment data (23) 

. prescribing instruction , .... (24)- 

. implementing prescriptions ...... (25) 

understanding language develo^j&^(26) 

,. facilitating language growth >(27) 

*^ 

ff 

.Mark one. box at the right tp indicate ■ 
your overall rating of this year's J 
project-w;ide inservice. (Consider only 
those activities involving total staff, 
at one time/place or in a series of 
sessions.) (28) 



LU e thz6z heading* to A in<$Lto£t the. 
qnphcu,4j> on each in&eAvici topic. 



§. 3 



0.0 
0.0 
0.0 
090 



0.0 



once- 
twice 


now $ 
then 


often. 


every 
time 


OMIT 


0.0 


25.0 


58.3 


8.3 


0.0 


16.7 


16.7 


5t>.0 


16.7 


0*0 


46.7 


0.0 


41.7 


41.7 


<r* 


0.0 


16^.7 


33.3 


50.0 


0.0 


0.0^ 




i 

50.0 • 


50.0 


0.0 


0.0 ' 


0\0 


.6^.7 


33.3 


0,0 


0.0 


0.0 


58.3 


41.7 


0.0 


use- 
less 


help- 
ful 


'•pretty excel 
good" -lent 


» 

OMIT 


0.0 


8.3 


25.0 


66.7 


0.0 
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5<-a. How many times this school year 
has a consultant teacher, reading 
specialist , curriculum coordinator * 
and/or project manager observed * 
' project operationsMn your class- 
room? V .../y. (29) 

5-b. On how many of thes| sccasions was: * 



the Classroom Observation 
Checklist used? 



(30) 



To what extent Has this yea^s in- 
service—individual (on-site) and 
/small -group, as well as project- J 
wide— provided, for your own special 
and individual needs? (32) 
s 



never 

0.0 
• 

none 
25.0 



. a post-observation conference/ 
discussion held with you? . ...*r. (31) . 



2-3 4-6 7— 
once times times times OMIT 

8.3 «- 33.3 25.0 25.0 8.3 



one two three four— OMIT 
41.7 8.3 0.0 25.0 0.0 



2S.0 33.3 8.3 16.7 0.0 



not 

at all 

0.0 0.0 



great 

some -ly OMfr 

16.7 25.0 58.3 0.0 



Comments : 



7, 










r~7 - 


























For how many pupils this year are you 
using each of the following "tools" 
for monitoring individual progress? 


NUMBER OF PUPILS— fat ITEMS 33-40 
none one two three 4 — 


t 

OMIT 


\ Class Assessment (complete) .. . ■ 


(33) 


0.0 


0.0 


0.0 


0.0 


83.3 


16.7" 


. Class Assess.— Visual" Skills only 


(34) 


16.7 


0.0 


8.3 


0.0 


41.7 


33.3 


. Class Language Assess, (complete) 


(35) 


0.0 


0.0 


8.3 


0.0 


75.0 


16.7 


.Individual Child Asses, (complete) (36) 


16.7 


0.0 


0.0 


0,0 


75.0 


8.3 


. Individual Prescriptive Program* 




0.0 


0.0 


0.0 


0.0 


91.7 


8.3 


. Macmillan Language Assessment 


(38) 


33.3 


0.0 


0.0 


8.3 


41.7 


16.7 




(39) 


7§.0 


0.0 


0.0 


0.0 


16.7 


si 


. T0BE Class Evaluation* Record .... 


(40) 


0.0 
» * 


0.0 


0.0 


0.0 


100,0 


0.0 


. other—Identify, 
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APPENDIX^ (Cont'd) 

8. To the right of each developmental ' 
area listed >below, mark in one» box ^ 

to indicate which ofnhe descriptors g * 

most accurately indicates the ade- £ © Son o c o-h 

quacy of vour records of individual -gtJo 2 § x s 2 a a> . h s 2 « 

childrep'sjprogress in that area g *j « M <g g « M *j g M £ 2 M 

this year. * g ^« «o fl g. o-o £ « £ QMIT 

r . social-emotional (41) 0.0 16.7" 8.3 16.7 33.3 25.0 0.0 

. psychomotor (42) 0.0 25.0 8.3 16.7 ZS^.O 25.0 0.0 

. language ' (43) 0.0 8.3 0.0 8.3 25.0 58.3 0.0 

. other cognitive areai * . .. (44) 0.0 8.3 0.0 8.3 ,16.7 66.7 0.0 

Comment s : 

9-a. Mark in the appropriate box to *g 0 3 . 2?' J! 

"describe the extent to which you § 3 " o * A § ■ s W 'o 



y^e PAP referral instruments (Ob- „ Z Q > w g5 £ g nwTT 

servation Guide..., Descriptive e ^ « 0tf) *h c « w u*ui 

Behavioral Assessment). (45) 16.7 0.0 33.3 16.7 33.3 0.0 







X 




»— i 




rH 




1 C3 




<3 G 




o o 


o 


O »H 


c 


O V) 


0.0 


33.3 


a 


\ 




\ rH 




O *J ft 


ft. > X 



9-b., How helpful are PAP instruments ' § s © «" 8 c c 8 c 4? * 

.(Observation Guide..., Descriptive U 8S «Joft>>» 

Behavioral Assessment, TOBE...) g g Q § .ti o o *3 c ©§ = oo * OMIT 

• in identifying children fco be ^ ♦* « - - -c u o .c.* o .= o ur[ 

referred to the program? (46) 0.0 0.0 25.0 0.0 66.7 8.3 



Comments : 



10. Khat one thing do >£U intend to do again/better/differenAy next year to increase, 
tiie livelihood that project goals wiAl be reached--and exceeded? 



i5 1 
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, * APPENDIX C 

o 

EARLY 'CHILDHOOD EDUCATION CLASSROOM STAFF SURVEY: JUNE, 1980 
PUPIL ADJUSTMENT PROJECT AIDES (N* 9) * 



WheJie comment* tf* explanation* o^e 04feed ; p£erae pfrfrit ok mite 
vvuj tzgibly, a&ing only the 4 pace provided. Ml otheA Kt*pon*t* 
'*houM be indicated by rnKkingr-X in the appKopniate box ion each 
-ctejn. tUe a ballrpoint ok 'JlaZk" pen, at a thcuip, dank pencil 



PER CENT 



Uae tftwe hearting* to indicate, the 
About how many of your* pupils have numben. oj pupil* &0K each item. 

you consulted this year with: ? 

. other Early Childhood teacher (s) 
and/ or teacher assistant (s)? ... (01) 

1 first-grade teacher(s)? (02) 

. jfrincipal? * (03) 

. Early Chifdhood supportive services: 

. consult, tchr. /reading spec.?(j$) 

. psychologist? (05) 

. social worker? (06) 

♦ . speech therapist? (07) 

."school's "regular" support staff: 

. nurse? (08) 

. psychologist? . '(09) 

. speech therapist? (10) 

. community agencies? (11) 

. parent/family representative? .. (12) 



none* 


one 


2-3 


several 


all 


OMIT 


11.1 


ll.i 


11.1 


22.2 


44.4 


0,0 


44.4 


33.3 


11.1 


0.0 


11.1 


0.0 


22.2 


22.2 


33.3 


0.0 


22.2 


0.0 


11.1 


11.1 


33.3 


, 0.0 


44.4 


0.0 


.11.1 


33.3 


0.0 


0.0 


55.6 


0.0 


11.1 


iz.z 


fr.O 


0.0 


55.6 


0.0 


11.1 


, 22.2 


11.1 


0.0 


55.6 


0.0 


22.2 


33.3 


0.0 


11.1 


33.3 


0.0 


66.7 


22. 2 


0.0 

• 


.0.0 


0.0 


11.1 


66.7 


0.0 


11.1 


> 0.0 


0.0 


22.2 


55.6 


11.1 


0.0 


11.1 


0,tJ 


22^2 


22.2 


22.2 


0.0 


22.2 22.2 


11.1 



.other--Identify*- 



-a. For approximately how many pupils U*e thz*e heading* Vindicate, the 

thi4 year has a parent or other numbet ~o& pupil* ion each itm. 
family representative: /about nuX 

none 1-2 several half a11 JP*V 

. conferred with you at least once 

(other than "intake," etc.)? (13) 11.1 22.2 11.1 11.1 44.4 0.0 

. conferred with you as often 

as once a month? (14) '22.2 • 44.4 22.2 0.0 11.1 0.0 



* {continued) 
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APPENDIX C CCont r d) 



none 1-2 several *half a ^ OMIT 

attended at( least one 

school -wideVoarentx meeting ...(IS) 11.1 55.6 11.1 11.1 11.1- 0.0**^ 

. attended at l east^ ne project/ ' 
Early. aiildh^Joatspecial program? (16) 44.4 22.2 11.1 0.0 11.1 

, borrowed maVgX^ls to use 
with child(ren) at home? (17). 22.2 66.7 11.1 0.0 0.0 0.0 

. visited in your classroom at* 
least once, to observe? (18) U.l 0.0 11.1 44.4 33.3 0.0 t 

. worked on a regular- basis as a 
volunteer \n your classroom? ... q 9 j 55^5 44,4 ' q.O 0.0 0.0 0.0 

. never "returned the call," re- 1 
~ : sponded tq,an invitation, etc.?. (20) 55.6 22.2 .- 22.2 , 0.0 0.0 , 0,0. . 

2-b. Describe briefly your major strategy this year for increasing parent involvement 
in children's education, especially by providing reinforcement during out-of- 
school hours/days . 



To the right of each activity listed, 

mark one box to indicate the extent uVe thuz heading* to indiaxtt tht 
to which that activity—involved in wpkcUxU on zach in6Z/tvice. topic. 
the individualization of instruction-- 

was emphasized in inservice this year once- now 5 every 

(individual, small-group, project -w,ide). never twice then often time OMIT 

. observing behavior (21) II. 1 11.1 0.0 55.6 22ta % 0.0 

. recording observations (22) 0.0 33.3 0.0 33.3 33.3 0.0 

. analyzing assessment data (23) 11.1 22.2 11.1 11.1 33«3 11.1 

. prescribing instruction (24) 22.2 55.6 22.2 0.0 0.0 0.0 

. implementing prescriptions (25) 0.0 11.1 11.1 44.4 33.3 0.0 

. understanding language development (26) 0.0 0.0 0.0 55.6 44.4 0.0- 

. facilitating language growth ... (27) 0.0 0.0 0.0- 55.6 44.4 0.0 

. Mark one box atjthe right to indicate 

your oyfiiaUxaiiQg of this year's - * 

project -wide inservice. (Consider ^ use- help- "pretty excel 

a only those activities involving ' ??? less ful good" -lent OMIT 

%r?£2'- JSi2^!." ew 0.0 0.0 u.i »* ss. 6 

■ ■ * ■ / 



\ 
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APPENDIX c (Cont'd) 



5-a. How many times this school year has a 
consultant teacher, reading specialist, 4 
4 curriculum coordinator and/or project' never 
manager observed project operations 
in your classroom? <29) 11. \ 



v 4 2-3 4-6 7~ 
once times times times OMIT 

0-6 22.2 44.4 22.2 0.0 



5-b. On how many of these occasions<jwas: 

,^the Classroom Observation 

Checklist used? 

• - 

. a post -observation conference/ 
discission held with you? ....... 



none 
.(30) 33.3 



j 

one 



two 
22^2 11.1 



three four-- OMIT 
22.2 0.0 11.1 



(31) 33*3 22.2 22.2 22.>2 0.0 0.0 



6. To what extent has this year's in- 
service—individual (on-site) and % 
small -group, as well as project-wide 
--provided for your oVn spepial and 
• individual needs? ^.^ 



not • 
at all 



some 



Comments: 



great 

-ly OMIT 



(32) -C.0 - 0.0^ 22.2 , . 0.6 77. a 0.0 



7. For how many pupils this year are you 
using each of the following "tools" . 
for monitoring indiviSual progress? - 



WUMBER 0F PUPILS—FOR ITEMS 
none one two three, 4 — 



. Class Assessment (complete) . (33) 11.1 0.0 0.0 

. Class Assess.— Visual Skffts only (34) £2.2 0.0 O.JO 

. Class Langauge Assess, (complete) (35) llA 0.0 0.0. 

. Individual Child Assess, (complete) (36) 11.1 0.0 0.0 

. Individual Prescriptive Program .. (37) 11.1 0.0' 0.0 

. Macmillan Language Assessment .... (38) 44.4 0.0 0.0 

. PEEC Instrument (SCOPE) (39) 66.7 0.0 0.0 

. T0BE Class Evaluation Record (40) 11.1 0.0 0.0 

. other— Identify., 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



66. 
44, 
55, 
66, 
66, 
22, 
22, 
77, 



33-40 
OMIT 
22.2 
33.3 



33_.3 

22.2 

22.2 

33.3 

11.1* 

11.1 
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. appendix c (Cont'd) 



8. a. To the right of each developmental 

ar$a listed below, mark in one_ box 4 g 

to indicate whiA of the descriptors g , - x „ 

most accurately indicates the ade- ^ x o o ~ « o ^ • o e o 



qulcy of xgur records of individual * -u * u -g o * g -g « o -g s --g 
children 1 ? progress in that area § © g -g g g g g g -g g g £ .g g 
this vear * § «§a «8fi « S-SS o"o^ ->T3(« OMIT 



social-emotional (41) 11.1 22.2 

psychomotor ♦ (\2) 11.1 22.2 



0.0 



language (43) 11.1 

other cognitive areas (44) 11.1 11.1 









* 




11.1 


0.0 


22.2 


33.3 


0/0 


11.1 


ll.lm. s 


0.0_ 


44.4 


0.0 


0.0 


22.2 


11.1 


55.6 


0.0 


0.0 


0.0 


nil 


55.6 


0.0 



Comments : 



9-a. Mark in the appropriate box to © rt u • g ( g * 

^ describe tHe extent to which- y^u * 5 o- « « ~s 

use PAP referral instruments (Ob- o o g g «g £ §■ *3 S OMIT 

servation Guide..., Descriptive ' * 

Behavioral Assessment) (45) 22.2 0.0 11.1 SS.6 11-1 0,0 

9-b> How helpful are PAP instruments §| 0 „ 2c S g £ e ^ 

- (Observation Guide.., Descriptive « © * >S cu su> x a su > § - 

Behavioral Assessment , TOBE. ...) gSo'SSoooeoe © *^ i OMIT 

in identifying children to be ~, " i° ?T 8 1i I n 0 

referred to the program? (46) .0.0 0.0 11.1 77.8 11.1 0.0 

Comments : j — 

10. WJ*t one thing do '.you intend to do again/better/differently next year to increase 

the likelihood that project goals 'will be reached-and exceeded. 



/ / 



i5o 
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APPENDIX D 
PUPIL 'ADJUSTMENT PROJECT: 1979-1980 
PRE-POST RESULTS: TOBE LANGUAGE/MATHEMATICS 



PRE-TEST* 



POST-TEST* 



' Mean Approx. Mean Approx. 
N NCE %-ile NCE %ile 



LANGUAGE 

Comprehensive 44 37.0 
Centers 



27 



MEAN 
NCE 
CHANGE 



53.3 



57 



+16.3** 



Adjustment 
Centers* 



61 44.9 



40 



51.%-. $2 



+ 6.6** 



Traveling 
Teachers* 



12- 44.5 40 



51.3 52 



+ 6.8' 



MATHEMATICS 

Comprehensive 
Centers 



44 38.5 



30 



43.6 38 



+ 5.1** 



Adjustment 
Centers* 



60 44.4 



40 



45.8 42 



+ 1;4 



Traveling 
Teachers* 



12 45.9 



42 



41.7 35 



4.2 



♦National norms were utilized: Pre-K for pre-tests and K for post-tests. 

**The proposed mean gain (at least 4 NCE's) was attained. 

^Results were analyzed only for children enrolled for at least nine weeks 
(Performance Objective 1). 



•1S7- 



156 



APPENDU E 

* 

# PUPIL ADJUSTMENT PROJECT: 1977-1980 
■ < ' ' COMPREHENSIVE CENTER 

P RE-POST RESULTS: I£VIhE-ELZEY .PRESCHOOL SOCIAL COMPETENCY SCALE 



FACTOR 


N 


PRE- 
Mean • 


SD" 


POST 
Mean 


SD 


t 


SIGNIF . 
LEVEL 


Self-Suf f iciency(13) * 




k 












1979-80 


43 


2.01 


.57 


2.95 


.51 


9.47 


p<1.0uT 


1978-79 


47 


2.13 


,70 


2.98 


.55 


6.41 


p^.001 


1977-78 2 

[ 


51 


-2.42 


-.68 


-2.78 - 


•.-74 


5.45 


p-c.001 


Emotional- Maturity(9) 






• 






■ 




1979-80 


43 


2.11 


.54 


2.97 


.52 


9.45 


p^.001 


1978-79 


47 


2.38 


.86 - 


3.17 


.54 


5.22 


p<.001 


1977-78 


51 


2.65 


.79 


2.90 

i 


.72 


3.07 


p<.001 


Social Ski lis Up) 
















1979-80 


. 43 * 


1.93 


.58 


3.02 


.63 


11.36 


p^.001 


/ 1978-79 


47 


2.19 


.73 


3.24 


.49 — 


8.01 • 


p<.001 


1977-78 


51 


2.61 - 


.63 


2.92 


.60 


4.35 


p<£.001 


Self-concept (1) 
















1979-80 


43 


2.14* 


.67 


2.91 


.56 , 


7.01 


p< .001 


1978-79 


47 


2.04 


.81 


2.80 


.65 


4.88 


p<.001 


1977-78 


51 


2.41 


.78 


2.51 


.93 


.74 


NS 


♦Number in parentheses 


indicates the number 


of items 


scored 


in the 


factor. 


















m 


) 

4 
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' \ ' APPENDIX F 

t 

/* 

PUPIL ^DJUSTMENT PROJECT: 1979 - 19&0 

RESULTS OF CITYWIDE AOMINISTRA^IQN (JUNE, 1980) OF METROPOLITAN • 
READINESS TESTS (LEVEL II, FORM P) TO KINDERGARTEN PUPILS 

Approx. 

MRT SCORE GROUPS N M - '%-ile SD t Signif. 



Pre-reading PAP 37 46.4 - ^44 8.6 

^Skills. *» 1.365 . NS 

Composite Title I 4,931, 49. f "49 - 12.9 

Quail ti- PAP ' 37 11.6 27 4.1 

tative Skill v ' 3.640 p^i.001 

"Area Title I *v4,917 14.6 45 5.0 



♦During the citywide administration of MRT, Pupil Adjustment Project children expected 
' 5 to be enrolled' in first grade (1980-1981) were tested. Their 'results (N = 37) were 

compiled separately from'those of other kindergarten children in Title I schools. 

CN = 4,917) . ' 

**Petfcentile were read/approximated from publisher's tables of national norms for. 
kindergarten • (Apri 1 -June) . 
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READING IMPROVEMENT PROGRAM 
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1979-80 Title I Evaluation 



PURPOSE A ND OVERVIE 1 

The Re^fog .Improvement Program is one part of the overall Read- 
wlJnProject far eligible students* j.n Title I Schopls. Clas- 
as a Corrective program for students in the primary grades, its 
main components include: % 

. Diagnosis Students who sc&re at or below the 33rd percentile on 
standardized tests aTe eligible for program service. , - 

Intervention Reading consultants provide? 45 minutes per day of 
individual instruction for classes of no more than six pupils. 
This instruction 'Is in addition to regular- classroom reading 
instruction. Varieties of procedures and materials are utilized 
for instruction. * 

Staff Communication Consultants maintain continued contact with^ 
regular classrqom teachers to monitOT students progress and provide 
update on Teading strategies. J 

Parental Involvement Parents are eWoujraged to become actively 
involved in the intervention processNli order to maximiscsiudent 
progress . *^ 

While services are rendered to both public and non-public school 
students, the program iti the Cleveland Public Schools was hampered by the 
11 week teacher stTike that occurred between October, 1979 and January, 
1980. ' ' 

SERVICE SUMMARY > • 

Number of Pupils Served : 1,783 Grades Served : 1-3 

/ Years in Operation : 13.5 

Number of Schools: 34 public 

10 non-public - ^ 
44 Total (A listing- of Project Schools 
may be foiSjid in Appendix A) 

Staffing : Ecfucational Program ManageT, 1 FT 
Assistant Project Manager, 2 FT 
Reading Consultant Teachers 42 FT \ 
^fterk ~- 1 FT A 

TotaLJTifcfe I Expenditures; $ 1,019,105 Per Pupil Cost: $ 569.65 

/ : 
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OBJECTIVES AND OUTCOMES 

♦ . Objective 1: The reading skills^of participating pupils (grades 
two through three) will improve as evidenced by-art increase in at 
least four NCE units in mean scores, on standarized reading tests 
.administered prior to and following project participation. 

. Outcome : Objective 1 was attained^. The Comprehensive Test of 
Basic Skills was administered on a pre-post test basis 
for grades two and three. A sample of students from • 
r these grades was chosen and NCE gain scores^were ana- 
lyzed for both the vocabulary and comprehension sub- 
sections. Grade 2 gains were measured at 17*11 NCE 
units for vocabulary and 15.08 units for comprehension, 
* while grade 3 gains were 5.60 points and 9.12 points 
respectively. Appendix B presents NCE information 
for 'each of these groups. 

Table 1 presents the sample results in comparison to 
p national norms. For both the vocabulary .^nd compre- 

hension subsections, students in grades $wo and three 
made significant percentile gains. Despite this fact, 
students still ranked well below average in their 
reading proficiency. Additionally pre-post raw score 
. gains for botk vocabulary and comprehension were ana- 
lyzed using ajt-test for repeated^ measures. These 
gaii\s for both grades were found to -be significant at 
the .001 levei, further substantiating the strength o£ 
the reading treatment. (See Appendix C for a summary 
of these statistics). / 



Table I 



Group Percentile Comparison 



ejjgjUe 





Vocabulary 


Comprehension 


Grades — 

2 * 
3 

»9 


Pre 

13 
19' 


Post 

* 

36 

27 . 


Pre 

13 
12 


Post i 

38/ 
2o 

/ 



/ 



Objective 2: Classroom teachers will rate at least/50 percent of 
participants as able to use classroom reading materials at least 
half of the time. / 

f Outcome: 'Objective 2 was attained. Each, o>i 90 regular classroom 
h 'teachers provided ratings for one randomly selected 

pupj.1 from their class who received small-group instruc- 
tion through the Reading Improvement* Project.- These 
ratings were collected by means of .a locally constructed 
questionnaire. This instrument measured the extent 
to which various reading skills developed in the Project 
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^ wera transferred into classroom performance. (The 
questionnaire, along with a data summary for the 
sample, may^be^ found in Appendix D) . . S.eventy-three . 
% percent of the* 90 pupils randomly selected from. grades v 
one, two,* and three* were rated as able to handle the 
usuil reading materials at grade level from 50% of the 
time to 100% of the time. Table 2 provides a summary 
of teacher Ratings. * . . 

Table II " 

Teacher Ratings of Pupil Ability 
To Handle Grade Level Materials 

M = 90 

Frequency of Response by Percentage 



100% of 
the time 


75% of^ 
the time 


50% of 
the time 


25% of' r 
the time 


Not At 
All 


No 

Response 




6% , 


44%' . 


23% 


21% 


4% 


1% 





V 



Objective 3: Project staff wilL maintain communication throughout 
the project year to facilitate pupil improvement in reading with 
50 percent of participating teachers providing a positive rating of 
the usefulness of servicV information resulting from their contact 
with project staff. ^ 

Outcome : Objective 3 wis attained. Information was collected 

! using the samkoj*st?ruraent described for Objective 2 y 
(ability of students to handle classroom reading ma- f 
• teri^Ls). Of the 90 teachers responding to this rating 
sheet f over 63 percent rated the e service information 
provided through contact with the project staff as 
"very useful 11 0r "extremely useful 11 . Table 3 provides 
a complete^™iary of the teachers* perceptions of 
service information. 



, Table it I ^ 

Teacher Ratings of Service 
Information" Provided by Project Staff 

N = 90 

Information Ratings by ; Percentage 



Extremely 
Useful 



If Ve 2VfUseful 
Useful 



Somewhat 
Useful 
/■ — 



Of .Little 
Use 



No 
Comment 



303 



33$ 



14% 



14% 



7% 
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Objective fr : At least 50 percent of. parents win report through 
responsesTTo the parent opinionrfaire that they have actively supported f 
their chiM's involvement with the project through individual* conferm- 
ents, attendance at parent meetings or other project -related activ- 
ities. - ♦ 

% 

Outcome : ^Ijjective 4 was attained. A sample of 87 parents 
responded to an opinionnaire de^tened' to ascertain 
parents 1 perceptions of the e"E^^B^veness of projject 
activities. The results of thrappinionnaire indicate 
that: s ^ 

Seventy-four percent' of the^reipondents exhibited active program 
support, either in the fomTof talking ^p^lw^r fchild 1 s reading 
con^ajitant, observing theiy child reading at school, attending 




pallet meetings, Br tffeking to othfers at school about their child's 
reading perfprmcn^. Categorically,, this involvement may be 
1 ■ ,broken dowrt'as TOTlows: 

. Talking to reading consultant '48% . 

** » 

~ . Observing child's reading, 33% 

. Attending school parent meetings 

. Talking to others at school concern 
reading 54% 

Summaries of these parent responses may be found in Appendix E. 
« * 

9 

ADDDaiONAL FINDINGS , 

. Over 73% of the parent respondents ifndicated that the program had 
helped them to help ttfeir child in reading. ' ^ v 

, ' Fifty percent Of the teacher respondents felt -the^e was "much" or 
"very much" improvement in the selected pupils confidence in his 
"or her ability to read/* 

Forty-six percent of the respondents to the teacher questionnaire » 
felt th0te was either "much" or "very much" improvement in the ^ 
selected pupils general attitude toward -school . 

Eighty percent of the parents surveyed replied that their qjhild 
reads more at home. 

A ■ 

. *. , Forty-nine percent of the parents surveyed indicated that they* ^ 
; noticed their child had been borrowing more books from the library. 



\ 



C 
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. SUMMARY AND CONCLUSIONS 

^During the 1979-80 school year, the Reading improvement program 
provided remedial services to 1,789 first, second, and third^grade pupils 
in. 34 public and 10 ijon-public schools. Based upon a review of -the perti- 
nent^data, it has been concluded that all four objectives have been attained. 

As a result of a pre-post analysis of the Comprehensive Test of 
Basic Skills, significant NCE gains^were recorded on both the vocabulary 
and comprehension subsections.^ These gains were more pronounced for 
students in grade two than those in gradei three. In analyzing ^question- 
naire responses for teachers, it was found that they tended to respond 
favorably towards the program, both in terms of effects of students in 
class and usefulness of staff contacts. Parents also reported favorably 
,on project activities, including home reading, reading improvement , .and 
'general project activities. 



ised on this data, the following recommendations can be made 
for* the 1980-81 school year: 

. Continuation of the diagnosis/small group intervention process. 

«s Maintenance of staff involvement and communication. 

"\ Encouragement for greater parental involvement, particularly . 
in the area of school visitaticSHs. , # 

. investigation into the discrepancy* between secxjnd and third 
- grade NCE gain Scores. . \x 

:> In conclusion, it is recommended that this project jbe continued 
and expanded for the 1980-81 school year. 



- & 



» 
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APPENDIX A 



PARTICIPATING SCHOOLS - READING IMPROVEK 



Public 




Alfred A. Benesch 
Anthony Wayne 
Bolton 
BdBlevard 

Captain Arthur Roth 
Case 

f field 
Dap?fel E. Morgan 

st Clark 
Giddings 
Gordon 
Harvey Rice 
Hazeldell ' ' ' 

Hodge - m 
Iowa Maple 
John D. Rockefeller 
John W. Raper 
Joseph F. Landis 
Longwood 
Louis Pasteur 
Margaret Irelar 
Mary B^^Martin 

cLeod Bethune 
lies * 
Miles Park 
Moses Cleaveland 
Mount Auburn 
Scran ton 
SowinskL a 
Stephen E 
Treraont 
Union 

Wade Park / 
Woodland Hills 



Ma: 



Howe 



Non-Public " 

Immaculate Conception 
Our Lady of Peace>^^" 
Mt. Pleasant Catholic 

St ' Catherine _ J, ~* 

St. Joseph Collinwood 
St. Joseph Franciscan 
St. 'Thomas - 
St.' Vitus * \ 
Urban Xommun i t y 
Reading Center 



'I Go 
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APPENDIX B 
NCE GAIN BY GRADE AND CTBS SUBSECTION 



VOCABULARY 



COMPREHENSION 





Grade 2 


Grade 3 


Grade 2 


Grade 3 


Total^Served 


662 


712 


662 


712 


Sample N 


98 


129 


97 


123 


Avg. »NCE Gain 


17,11 


5.60 


15'. 08 


9.12 




■J 
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- APPEN DIX C 

i "' 

T VALUES FOR SAMPLE CTBS GAIN 





Vocabulary 


Comprehension 


Grades 


t 


df 


-P 


t 


df 


P 


2 


18.32 


98 


<001 


— \13.10 


94, 


■ <001 


3 


6.91 


112 


«001 


9.90' 


118 


<001 



i 




* APPENDIX D 
SUMMARIES OF TEACHER OPINIONNAIRES 

Schpol 



\ 




Reading 
Improvement 



Pupil Rating Sheet 
Reading Instruction Program 
1979-1980 



; N = 90 



has been receiving services of the Reading 

Improvement Program. We are interested in securing from you, his/her 
classroom teacher, ratings and pertinent information about his/her 
reading performance. Please complete, check and return in the school 
mail using the attached envelope sealed to the address indicated no 
later than Friday, June 27, 1980.- 



1. Child's birthdate. Ag e 

Month' c Day Year 6/81 



2. Present grade level [ In September 



3. Reading mark assigned 



.Division of Research ?nd Development 
June, 1980 



APPENDIX D (Cont'd) 



4. In your opinion, can this child handle the usual reading material 
for his grade level? (Check the appropriate box.) 



100% of r 
the time ' 



^% of 
the time 



/ 44% 



50% of 
the time 



233 



j 25% of 
the time 



2V, 



Not 



at 



all I 1 



No 

Response 



5. In general ,* have you n^ted^ any degree of improvement in: 



None 



Very 



No 



a. Pupil participation in group work 



b. Completion of reading assignments 



c. Pupil confidence in his ability 
to re'ad 



d. Pupil independence in reading 
study skills 



e. Pupil's general attitude -toward 
school ■ 



10? 



Some 


Much 


Much 


51% 


34% 


12% 


56% 


22% 


13% 


39% 


32% 


18% 


50% 


31% 


/ 

8% 


41% 


30% , 


16% 



1% 



9 
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6. From your knowledge of this pupil's work xn your. clas sroom how 
would you rank this child's, reading performance as described below 
in relation to the other children in your class. (Visualize your 
class as being divided into fifths ) Rate on * those skil s or 
' which you referred child (items a through 2). All teachers please 
complete items k and _1. 

Number of pupils in class 





g. 


Rank in Class 






(Please check) 


Top 
1/5 


Second 
Highest 
1/5 


Middle 
1/5 


Second 
Lowest 

Y/s 


Lowest 
1/5 


No 
Respons 


3- . 


•rornoTii 71 TIP COTiSOnSH't 

sounds 

recognizing vowel sounds 


%% 


21% 


53%' 


12% 


18% 


8% 


b. 


8% 


16% 


30% 


19% 


22% 


6% 


c. 


4^AMf{ Anna ci &Ht" WOTdS 

laenuiiyxng bigm- nwxu^ 
for grade level / 


6% 


20% 


32% 


17% 


21% 


4% 


d. 


pronouncing words Bjt 
grade level 

-reading orally without 
undue frustration 


1% 


'21% 


33% 


19% 


21% 


4% 


e. 


1% 


14% 


33% 


21% 


19% 


11% 


f. 


finding main ideas 


2% , 


9% 




23% 


'29% 


6% 


g- 


following sequence 


3% 


' 9% 


37% 


19% 




10% 


h. 


getting meaning of words 
from^ontext 


W 


' 11%. 


31% 


28% 


21% 


' 8% 


i. 


recognizing directly 
stated details 


1% 


13% 


29% 


24% 


21% 


- 11% 


3- 


drawing conclusions t'rom 
facts or statements^ 
participating in reading 
group . 


' 2% 


10% 


29% 


23% 


27% 


9% 


k. 


9% 


20% 


30% 


'22% 


17% 


2% 


1. 


qpmplSting written 
assignments 11 


7% 


17% 


21% 


23% 


32% 


0% 



7 Tn'what aspect of reading do you feel that the child has improved as 
. a result7f receiving the services of the Reading Improvement Program? 




9 
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« < 

8. What type of communication was maintained between you and' project staff 

while pupils from your classroom were participants in the project? 

\Ex: conferences, ' informal talks, classroom observations, etc.) 

. • . ) 

"Informal conferences . . . group meetings . . . classroom observations . . 




9- What benefits dicf you derive through these lines of communications? 
"More consistent evaluations ... coordination of services ... more 
consistent reinforcement ... specific diagnostic information ..." 



10. In general, tiow useful wot^ld you rate the service information provided 
- through contact *ith the project staff?' 

- Extremely Very Somewhat / Of Little No 



Useful 
5 


Useful 
4 


Useful 

, 3 


Useful 
2 


Use 

1- 


Response 


30% 


33% 


14% 


14% - 


7% 


1% 



LI. How could this service information be improved? 



' "More regularly scheduled meetings with project staff ... more 







classroom release time for meetings . 


. more opportunity to observe 


students in remedial situation ..." 


V 



12. Please include comments and recommendations for future project gTowth 
.on the following lines. 

"Closer correlatio n between classroom and remedial servi ces . . . 

expansion of services to help more students wljo need help ... 

greater communication among total staff *.." 
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.APPENDIX E . ^ 

SUMMARIES OF PARENT OPINIONNAIRES 

Child's Name 



CLEVELAND PUBLIC SCHOOLS 
Reading Improvement Program 
N - 87 

\ 

'Dear Parent or Guardian: *<iv 

'^^L We are contacting parents who have youngsters who have been 

participating in the Reading Improvement Program here at / 

School. 

Would you please help us by tellijtg us what you think about this program? 

1. Do you have a son or daughter in this program?, 61% Son 39% Daughter 

2. ffi what grade is your youngster? 1 = 23%; 2 = 41%; 3 - 36% 

3. Has the program helped your child? ' 

Not at All 8% Very* Little 30%Some*61%Vfry Much & No Response 

4. What does your child say* about the program? "Likes it very much ... wants 
'to continue-... helps in reading in class ..." ^ 

5. Have you noticed that your child reads more at home? 80% Y es 17% No 2% No Resp 
^6. Have you noticed that your child takes more books from the library? ^ J 

49% Yes 5 25% No 24% Not Sure 1% No Response 



7. How did you find out your child was in this program? 

45% Letter 33% C hild Said 18% T eacher Called 4% O ther *> 

8. What's the best thirig about the pTogram? ''Individual attention ... helps to 
read better ... helps in regular school work ..." 

9. Has the program helped you to help your child in reading? 73% Yes 6% No 
15% Not Sure _6% No Response 

If yes, how? "Greater confidence in. reading ... greater reading fluency ... 
ask" more questions ... greater interest in books ..." 

10. Did you talk with the reading consultant about your child f s reading? 

48% Y es 47% N o 3% Not Sure _1% No Response 

11. Did you observe your child reading at your school? 

33% Ye s l=23*a How many times? 60% N o 6% Not Sure 46% No Response 
~~ " 2=23% * # 

3= 4% 
4= 4% 
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12, Did you attend any parent meetings concerning the reading program at 
your school? * 

55% Yes 59% No 7% Not Sure, 1% No Response 

How many meetings? _^ 



15. Have you visited the school to talk to others about /our child's 
reading? ^ % 



54% Yes 45% No V 5% Not Sure 



If yes, with whom did you talk about your child's reading? Put a check 
mark in as many boxes as you need. 



Principal 



8? 



Child 1 ^Teacher 90% 1 Asst. Principal 

1 — c 



Please return this form with your child to the reading 
consultant, in the same envelope in which you receTved 
the questionnaire by Friday, June 15, 1980. 



Thank you, 



Division of Research and Development 




READING STRATEGY PROJECT 

( 



Prepared by" 

Gwendolyn Mprton Watts 
Consultant Teacher 



Typed by 
Cheryl D. McFadden 



Margaret Fleming 
Deputy Superintendent 



1979-1980 
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READING STRATEGY PROJECT 
\ 1979-80 Title I Evaluation ' 

PURPOSE "AND OVERVIEW / 

. The Reading Strategy Project is designed to assist eligible .pupils, 
grades four through six in public schools and grades four through eight in 
non-public schools,, in the mastery of basic reading skills and improve their 
attitudes toward reading. Supportive teachers, working with small groups with- 
in the classroom during regularly scheduled Language Arts periods, implement 
and extend the skill instruction initiated by the classroom teacher.' Priority 
is given to pupils in grade 4. Grades 5-6 in public and 5-8 in non-public r 
schools are provided 'service on a space available basis. Students are 
eligible for project services who score at or below the 33 percentile (42 NCE) 

on the Stanford Diagnostic Reading Test. x 

The project focuses on basic reading and study skills of the core 
reading program. This is accomplished by diagnostic testing and prescriptive 
teachingSRindertaken by the classroom teacher and the reading strategy teacher 
in a team approach. Additional supportive services provided are: speech and 
language therapist, psychologist, parent education counselor, educational 
assistant* and staff aid. 



SEftyiCE SUMMARY 



\ 



t 



dumber of Pupils Served : 8,028 total Grades Served : 4^6 public 

7,758 public 4-8 non- 

270 non-public public- 

Number of Schools : 86 total Years in Operation : 6% ^ 

77 public 
, 9 non-public 

(List of schools in Appendix A. ) 

Staffing : 1 Project Manager FT 

1 Assistant Project Manager FT 
__9LReading Strategy Consultants FT V \ 
90 Reading Strategy Teachers FT- \ 

'1 Psychologist PT * 

2 Speech and Language Therapists FT 

2 Clerks FT i ' /" v \ t \ ' . 

• ' 1 Parent Education Counselor FT * \ 

/ ¥ 1 Educational Aides FT. 

1 Staff Aide FT / \ 



Total Title I Expenditure 5 : $1,-929,718 Per.4>upil Cosj : $240* 



*Title I in addition to general fund. 
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OBJECTIVES AND OUTCOMES : 

. Objective 1 : Participating pupils lit grades four, five aftd six will 
evidence an avenge post treatment 'score that is at least four NCE 
units above expectancy. Data for each grade will be based on 
regression analysis (Model C) of the Stanford Diagnostic Reading 
Test (SORT) comprehension section,* administered in September, 1979, 
Test 1 and the Comprehensive-Jests of Basic Skills (CTBS) compre- 
hension section, administered in April, 1980, -Test 2. 



pmes: ^ 



The, decisloft^was made to use. the CTBS (comprehension section), 
administered in th^ spring, 1979 for Test 1 instead of the SDRT. 

\ „ To assess progress toward the attainment of the objective, the 
test performance of students served by the project was compared 
with an estimate of what their test performance would have -been 
if they had not participated. This "expected 11 level of perfor- 
mance was obtained by conducting a regression analysis on the 
test scores of a comparison group of students who scored above 
1 42 NCE units and who were not served by the project. This . 

- — w analysis made it possible to predict Reading Strategy students 1 ' 
performance on the Spring, 1980 administration, of the CTBS from 
their performances on the Spring, 1979 administration of CTBS/ 
Their actual scores on the ^ring, 1980 CTBS were then compared 
with their expected scores to determine if participation in the 
project had raised their performance above the level that would ^ 
be expected if they had'not participated. 



Outcome : Grade 4 

Matched scores (NCE units) available for a sample of grade four 
participants in the Title I Reading Strategy project and a com- 
parison group (using CTBS Spring, 1979/CTBS Spring, 1980) 
yielded the following data- 



*» Grade 4 
1979 - 1980 



Mean- Score (NCE) ** 
, Test 1 . Test 2 
Group N CTBS-79* CTBS-80* * 

** , 

Served 484 30.25 ' 31.09 

Comparison 2857 55.72 42.24 . 

\ — : . . 

4 

* Level 1, Form S, administered in grade 3. 
** Level l^Jforw^S, administered* in grade 4, 



The application of regression "analysis (Model C) to these data gave the' , 
following- results in' NCE units for the s'erved group. . . 



J* 



• ^* _ _ Effect\of ■ 

Grade Predicted X Obs^gyed X Program t * t 

* * - — \ — . — A 

V *27.66 -31\09 . 3.43 -2.07* , v r 

v , , * ' ' l ^ 

*p < .05 

The .result show th^t the participants scored significant ly^ higher than 
it wis predicted they would have scored without participation in the 
•project. The difference of 3-43 NCE units* between the observed and 
predicted scores approached but did not meet the criteria set by'the * 
objective.^ Since; a positive difference of at ]>past 4 NCE units was not 
obtained, the objective was not attained at grade 4. (See Appendix B„, 
page 13, for a summary of grade 4 regression Analysis.) • 

Outcome: Grade 5 - ^ ' 

Matched score&/(NCE units) available for a sample of grade five participant 
in the Title 1" Reading Strategy project and a comparison group (using ^ 
QTJ'S/CTBS) 'yielded the,.following data. 



Grade 5 

.1979 - 1980 .. \ 



). 



.- ' •• .• • Mean Score' (NCE) 

y Test 1 Test 2 

Group, s N ' CTBS-79* CTBS-80* * \ 

♦Served :*>*58, ,27. 9" 1 33.34 

. Comparison 2250 . 55.23 52.83 



W * Level "2, Form S, administered in grade 4. • 
y**Level 2, Form T, administered in grade 5. 



The application of regression analysis^ (Model C) to these data, gave the 
following results in NCE- units for the^served group. 1 



t 



/ \ m t _ 'Effect of' 

Grade Predicted X Observed Program' t ' 



28. SO • 35.34' 6.84 -• 5.40** 

. \ , — — 

-**P<-?1 ■ ~ * ' ' ' 
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The results show that the participants scored significantly Jhigher 
than it was predicted they would have scored wiyhout participation 
in the project* The difference of 6.84 NCE units between ttie 
observed # and the predicted score met the criteria set by thVobiec 
vtive. Since a difference of at least 4*NCE units wias obtained,"^) 
the objectives was attained at grade 5. (See Appendix b, page 14< 
for a summary of grade 5 regression analysis.) ' 

Outcome : Grade 6 , 

Matched scores (NCE units) available a sample of grade six 
participants in the Title I Reading Strategy project-, and a # com- 
parison group '(using CTBS/CTBS) yielded the following data.* 











Grade 6 
1979 - 1980 




> > 

Group 


, Mean Score (NCE) s 
Test 1 Test 2 7 
N." CTBS-79 * .CJBS-8D ** 




Served 


3£2^ y 28.34 34.26 




Comparison 


2669'^ls!71 53.62 

£ , ■ \ 





*Level 2, Form*?/ administered in grade 5. 
**Leyel 2,VForm S; administered in grade 6. 

\ 

The application of regression analysis (Model C) to these data 
g£ve the following results "in NCE units for the served group. 



Grade Predicted X . 


Observed X 


Effect of 
Program 


t 


> 6 ^ 3ft ^ 6 

— & : _ 


34.29 


3.90 2. 


40** 



**p .01 * 

\ 

The. results show the participants scored 'significantly higher 
than it. was predicted they would have scored without participation 

f in the project. -The difference of # 3.9Q IKE units between the ; 

* observed and predicted scores very d^^ly" approached the" criteria 
set by the objective. Since, a positive difference of at least '4 
NCE units was- so. closely approached, the objective was considered 
attained* at grade 6. (See Appendix- IT, page 15 for a summary of 
grade 6 regression analysis.) 0- /.« . 

(5ee Appendix B, page 12, Table 1 for NCE scores ^nd correlations 
for the served and comparison groups'.) 
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''In ordei\ to illustrate the performance level of Reading Strategy 
students relative taxational norms the table below shows the percentile 
rank of the average scores achieved at each grade level. 

Performance Levels of Reading Strategy 
Students Restive to National Norms / 



1 


Percentile 


Rank 




Grade 


Test- 1 
CTBS-79 % 


Test 2 
CTBS-80 




4 


17 ■ 


18 




5 


15 ■ 


24 




6" 


15 


23 













The percentile data show that, despite the gains achieved, the 
performance levels of the children served by the project remain low and 
the need for continued support is evident. 



Objective 2: Participating pupils will demonstrate significantly 
(p < .05) improved attitude toward reading, as r.efletted in the com- 
parison between mean pre^post responses .on a Pupil Attitude Survey. 
This performance will be evidenced by raiuiomly selected participants ^ 
in gradesx^our through eight. • _ \ 

. Outcome : Ah eleven week teachers' strike followed by assignment of 
- additional personal Knew to the project) created conditions which m 
< Jiampered efforts to ra^arch and deyelop the . appropriate instru- 
ment needed for the pre-post model proposed in this \>bjectiver 

- . r\ (V 

Data relative to\th is obj ective^were not» collected . 

7 ^ \ ' ! * 



Objective 3: * As evi<fenced by their opiniorinaire responses, teachers 
will become sBnsitiz/d to- instructional techniques utilizing the 
'diagnostic-prescriptive approach. 

. ' Outcome': In June, 1980, a questionnaire -was distributed £o teachers 
whose- classrooms were served by*the project.. All 100% of the class 
room teachfers (N=57) « responding to # the questionnaire reported 
changes had occured in their instructional procedures through the 
use o^the'diaenostic-prescriiptive approach, evidenced by: 



*- . ^unproved organization of lesson plans. 

.. extensive use of the Probes guide for teaching- the _ 
skills in grade four. 

. improved selection of students for instruction for , # ' , 
■ .specific reading skills. **\ * 

. \increased flexibility in. grouping of students for 
instruction. 

(See Appendix C for the summary of^eikssroom Teachers Opinionnaires.) 
- This objective waa^co\igidered attained. 

/ 

' Objective 4: Eighty percent of the parents of the project participants 
will report Satisfactory feelings about their child's reading^ improvement 

Outcome: In June, 1980, opinionnaires ^ere sent "to parents of 
project participants in 25 schools that received continuous service 
during 1979-80. The sample included the parents of one boy and one 
girl from each grade (4,5,6). Responses of the sampled parents 
(N=136) indicated satisfaction with-their child's reading improvement. 

Barents, when asked these questions, resided as follows: ^ 

". '*Does your child read better now?", 96% of the parents responded 
yes. . 

¥ 

' . ••What do you think of the help in reading your child received?!', 
88% responded "Good" to "Excellent" hdlp. 

"Would you like. the Reading Strategy Program to continue to , 
help Vour child°with reading?", 97% of the parents responded - 
* yes\j) . . C 5 , 

Comments were: 

very pleased with progress- *V « ■ 

i 

understands what is read w • ' . _ 

'impressed with confidence, in reading 

improved progress in reading with th^| program # ' ^ 
continue the program - ■ i <~ 9 

\ ' . v \ > V - 




\ 



^1 ■ V < 



Evidence of improvement cited by tae parents included: 

increased* interest in utilizing skyLte,e,g. pronouncing words 
by syllable, reading ads and television commercials. 

improved comprehension by expressing the main idea and 
drawing conclusions. 

. increased interest in reading additional books. * * 

♦ increased interest in -reading to siblings. 

(See. Appendix D for Parent Opinionnaire Summary.) 

Objective 4 was attained. 
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ADDITIONAL FINDINGS . „ 

Alternative! Instructional Approaches 

\ The scope of this program was evident in the services it pro- 
vided pupils (N=8,028) through the regular Reading Strategy program in 
which the Diagnostic Reading Probes jjn grades 4 and 5 and the Curriculum 
In Student Study Skills in grade 6 ftel^e the instructional base. This pro- 
gram also included several components to provide alternative instructional 
approaches for groups of students with special needs. Identification and 
V a description of each component are: 

. The Tuforing component schedules pupils on a one-to-one or one 
to-trar basis 'at least three days per "Seek. Tfie Reading 1 ^ 
Strategists fundamental focus was unmastered vocabulary and 
comprehension skills during these sessions, Pupils were ser- 
viced approximately jix weeks (in addition to regular Reading 
0 Strategy service). Evaluation for termination of this ser- 
vice in this component is through informal and teapher m&de 
test.— ' a *, ~~f ~ ' 

. 'The Multi-M<jdalities Skill Centers (7 schools) employed a team 
approach to (1) diagnose learning modality preferences, (2) 
shaire findings with parents, schoof staff and Reading Strategy 
. / personnel, and (3) plan individualized prescriptive, teaching 

programs for each pupil identified ^ Instructional teaching 
packets Were utilized. These .packets consist of materials de- 

* signed to correlate with the dominant . learning modality of the >! 

* learner. 

In this model, the, speech pathologist is prominent in the* 
identification of the pjtipil and development o£ the prescrip- 
tive plan. s 
* 

. The Language Experience Centers (7 schools) served pupils 
. eligible for service in grades 4 arid 5. The selected students 
were ( provided opportunities to combine reading skills with oral 
and wri\tetfi language development. A variety of methods and 
. " , material^ were combined to provide activities to build vocabu- 
/ lary^ increase comprehension, ^Lnd enhance oral and written 
- ~ language sleills. 

) . . the Reading Learning Center (1 school) served selected eli- 
.gible gTade 5 and 6 students. This method utilized the New 
Century Lab approach. In this model instruction was received 
via tapes. The lessons are self-evaluating and self Racing. 
Pupils were "pulled out" at various stages, for ski 1 ^instruc- 
tion by the Strategist. ^ * ^ 

Each model uses selected rjaterials with both mdtivational and 
prescriptive value. These materials may be teacher made^or commercial. 



/ 
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The resource center materials (loans) have been used most effectively to 
.accommodate specific needs in the components. Supportive and consultant 
staff are^ available for additional evaluation and support. No attempt 
was made to 9 compare NCE gains for each component. 



Supportive Services 

The supportive services" provided through the Reading Strategy 
program are germane in the identification of the specific reading problems 
that haveV retarded pupils progress. These services must include' the neces- 
sary personnel required to coipmunicate the findings and present possible 
solutions A that are provided by the Reading Strategy program, $o the parent, 
classropm^teachfcf ind others. The services .provided during the 1979-80 
school year were? 

The speech therapists were instrumental in identifying individ- 
oSI^pupils with speech, hearing and language problems, related 
to reading. Consultation. services were provided concerning diag- 
. „,iLOSticLand remedial information^ to best serve the pupils needs. 

The psychologist provided consultation services regarding the 
needs and abilities of pupils referred for service. This infor- 
mation is made available to school personnel, parents and pro- 
ject staff. 

Parent involvement has been a primary goal. On-going "communi- 
cation on an individual and a group kasis is a key factor in , 
securing* parent support.' This project provides materials and 
suggestions for parents to assist their child ift reading at home. 
This necessitates the inclusion of apparent education counselor/ 
advisor on the" project staff. The parent education counselor/ - 
advisor was instrumental in: • 
* ' * 

. . Explaning the purpose of any special service e.g, 
-'psychological testing or language assessment. 

. • Obtaining parent consent for special services as re- 
" # quired by due process. 

\ Organizing meetings for#project parents. 

Encouraging 'parent involvement in the district ad- 
^ visory -council and project school advisory connfiittee. 

' , . Encouraging parent use of the project's Resource Center,. 

• Serving as liason that arranged services to project pa- 
rents provrdedrby community agencies and groups. 
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Iriservice Program 



Inservice with a program of this scope is essential for orient- 
ing the Reading. Strategist and coordinating project services and resources, 
The monthly inserviie programs and workshops focused on these cdRcems: 

• On-going orientation to current program- needs . 

* . Clarifying respective roles and responsibilities in the 
— ^ Reading Strategy program. , 

« 

. Developing and improving' skills ajs reinforcing agents to 

assist the classroom teacher. » 

*- 

. Upgrading skills in motivating pupils. 

Effective means of communication with school personnel 
and parents, 

— - ^Jncr^sed^awareness^of characteristics and needs of pupils 

that are served by the project. 

Identification of current trends in methods and materials 
-« which, mi gfti be effectively xtsed to upgrade the reading 
abilities l$f pupils in the project. t 



Additional on-site inservice provided by Reading Strategy 



Consult 



(See APPENDrX^for the-summary of the Staff 'Perception Survey.) 



Dissemination 



The Cleveland Plain Dealer (a local newspaper with 395,452 daily 
circulation) distributed a Supplement of Reading Skill Activities submitted 
by the ^Reading Strategy Project, under the auspices of its Living Textbook 
Program. These activities reached thousands of homes and were used, hope- 
fully, to help children, practice and improve their reading skills. 



r 
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SUMMARY AND CONCLUSION * 

This report represents the results of the second application of 
regressio^analysis (Model C) for evaluation of the Title I Reading Strat- 
egy program. Test scores obtained from the CTBS test administered in /the 
spring, of 1979 were compared with test scores obtained from CTBS test 
administered- in the spring of 1980. The results werP* Converted into mean 
NCE scores. 

The sample included 25 schools. The criteria^for selection of 
served participants were pupils who: 

. scored at or below 42 NCE .units on the SDRT (comprehension 
section) administered in the fall of 1979. 

. received continuous service throughout the 1979-1980 
schooL year. 

. had a set of paired scores available from the city-wide 
& testing program CTBS (comprehension section) administered 
in tHb spring of 1979 and the spring of 1980, 

The comparison group selected contained students who scored above the 42 
NCE units of the CTBS (comprehension section) administered in the spring 
of 1979 and had a matched score from the CTBS ^pAmprehension section) 
administered in the spring of 1980. . 

The results revealed that in each grad e (4,S,fi3 the participants , 
scored significantly higher than it was predicted they would have scored 
without project services. However at grade 4 the effect of the program 
was 3.43 NCE units ^between the observed and predicted scores. This gain 
approached but did not meet the criteria set by the objective of 4 NCE 
units. At grade 5 the effect of the program was 6.84 NCE unrts^ between 
the observed and predicted scores. This^gain did meet the criteria set by 
the objective of 4 NCE units. At grade 6 the effect of the program was 
3.^0 NCE units. 'This gain was considered to meet the criteria set by the 
objective of 4 NCE units. Although predicted ^ehieve^ent-ievel-^ere at- 
tained at Grades 5 andj 6, ovltall performance levels remained**Tow when 
compared with national norms. 

Classroom teachers (1^7) reported changes in their instruc- 
tional precedures through the use of the diagnostic -prescriptive approach. 
TeacHex5^-ihdicated the improvement in lesson planjprganization, student 
selection, and flexible student grouping, for reaching instruction. These * 
improvements in turn contributed to students' .improvement in reading. m 
Utilizing these improvements, teachers were able to provide individualized 
instruction as well as reinforcement to pupils. Classroom teachers 
- through use of the diagnostic-prescriptive approach "recognized individual 
pupil needs-. * 

* 

Parent and teacher responses indicated pupil improvement in' the 
'application of basic reading skills. As skills improved, students' atti- 
tudes improved, as evidenced by their increased interest in reading addi- 
tional books and other materials. Responses from the parent opinionnaires 
(96.%-) Reported improvement in their child's reading. Parent expressed 
satisfaction with the program, .g^idence cited included improved reading 
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rate, better understanding of word meaning and improved recall of content. 
Parents recommended the program be continued. 

The evaluator concludes from, the findings and on-site observation 
that the program is a direct service to > individual and* small groups of 
midpnt c . Ih£-,program ! s instructional approach is a definite plan- of 



sequential-step presentation of basic reading skills by a certified teacher 
to eligible upper elementary pupils. Continuation of the project is 
recommended. ~ 

The evaluator recommends the results of the application of re* 
gression analysis (Model C) presented in this study be scrutinized by a 
national expert in regression analysis (Model C) . After the expert 
completes the evaiaution of the results of the local application *of regres- 
sion analysis, a recommendation can be made for future use of .regression 
analysis (Model C) in the TitTe I Reading Strategy program. 
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APPENDIX A 
READING STRATEGY " 's 

ELIGIBLE TITLE I ELEMENTARY SCHOOLS ■ 
1979-80 School Year 
(Rank Order) 

Public 



Non-Puj^fe 



1. 


Hodge 


41. 


Harvey Rice 


1 . 


2. 


Doan 


42. 


Union (L.E.) 


w ~2 . 


3. 


Wade ParkCL.E.) 


43. 


Buhrer 


3.- 


4. 


Sowinski 


44. 


Mt. Auburn 




5. 


Longwood 


45. 


O o /*■• L' -t- -t- 

baCKett 


< c 
o . 


6. 


Geo. W. Carver 


46. 


Anthony Wayne 


6. 


7. 


Charles H. Lake 


47. 


Willow 


7. 


8. 


Stephen Howe 


48. 


'East Clark 


8. 


9. 


Margaret A. Ireland (L.E.) 49. 


0. H." Perry 


9. 


10. 


Paul L. Dunbar' (MMC) 


50. 


H. W. Longfellow 




* 

11. 


Giddings 


51. 


Paul Revere 




12. 


Hicks 


52. 


Robert Fulton 




13.. 


Charles Orr 


53. 


Gordon 




14. 


Alfred A. Benesch 


54. 


Clark 




15. 


Mary M. Bethune (R.L.C.) 


55. 


Corlett 





Mt. Pleasant Cath . 
Our Lady of Peace - 
. Urban Community 
St. Timothy 

St. -Mcheal „ - « 

St. Joseph (Collinwood) 

St. Aloysius 

St. Francis 

9. St. Paul Croatian ^ 



East Madison 56. 

Hazeldell 57. 

Captain Arthur Roth (L.E.) 58. 

Mary B. Martin 59. 

Boulevard 60. 



Buckeye -^ood 1 and 
Kenneth Clement 
Longmead* 
Garfield 
Joseph Landis 



Kentucky 61. 

J. D. Rockefeller 62. 

John W. Raper (MMC) ' 63. 

Chesterfield * 64. 

Miles Park 65. 

Bolton * * 66. 

Case.. • 67. 

Tremont 68. 

F. H. Parkway 69. 

Ipxxis Pasteur 70. 

Dike 71. 

Woodland Hills . 72. 

Daniel E. Morgan (NWC) 73. 

Orchard * 74 . 

Anton Grdina (L^E?X 75. 

ScrantQn (MMC) ■ 76. 

Walton 77. 
Lafayette 
Watterson 

Marion-Sterling 0*1C) 



Charles Dickens 
Marion C. Seltzer 
Mound 

Halle (L.E.) 

A. J. Rickoff (MMC) 

Harvard 
Fullerton 
Eas„t Denison 
Gilbert (L.E.) 
Lawn 

Brooklawn 

Nathaniel Hawthorne 
Mil£ord . . 
Emile DeSauze 
■> Crdpwood 

Artemus Ward 
Waverly 
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' Table 1 

Test l a and Test 2 CTBS Reading Scores (NCE) an|l 
' Correlations* for the Served and Comparison 

Groups* in Grades 4, 5, and 6 r 
1979-1980 



Served Group (NCE< 42) Comparison Group (ffiE*>42) 

Graffe _ _ ' Z Z f * ~ 
N Test 1 X Jest 2 X Chajjjp Corr. , N Test 1 X Test 2 PC Change* Co;rr, 



4 " 


484 


30. 


25 


31 


09 


0 


84 


• .12 


2857 


55 


72 


49.24 


-6 


48 


.49 


5 


558 


27. 


91 


35 


34 


7 


43 


.18 


2250 


55 


25 


52.83 


-2 


.42 


.49 


6 


382 


28. 


34 


34 


26 


5 


92 


.37 


2669 


55 


71 


53.62, 


-2 


09 


.55 



a CTBS Reading Test April/May, 1979, 
b CTBS Reading Test May, 1980. 



» 
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APPENDIX B 
Table 2 

A Summary of Regression Analysis 
(Mociel C) data for the Fourth Grade 



/' 

A 

Nuihber''of pupils 



r 



Mean af Test 1 scores 

S,D . of Jest 1 scores 

Observed mean of Test 2 socres 

S.D . of Test 2 scores 

Correlation of Telt 2 with 
Test 1 scores * 

Slope of regression line for 
predicting Test 2 from Test 1 scores 

i 

Estimation (Prediction) equation 

Standard eyrror of estimate 

Test index of estimation 

Significance of the estimation 

Estimated mean of Test 2 score , . 

Effect of ProgTam 

*Tes't index of treatment effect 

Statistical significaM^of 
'treatment effect 



SERVED GROUP 
(NCE < 42) 

484 
30.25 
• 8.53 
31.09 
13.39 

.12 

.19 



COMPARISON GROUP 
(NCE > 42) 

= : "*'"28S7 

S5.72 
8.41 
49 . 24 
.14.67 

.49 



\ 



.85 



Estimated Test 2 score' = 1.95 + 
.85 x Test 1 score 




♦ 12.82 



£< .05 
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APPENDIX B 
Table' 3 



> 



A- Summary of Regression- Analysis 
(Model C) data^ for the Fifth Grade 



.\ - : •' ; , ■• 

Number of pupil s, * * * 

Mean of Test'l scores f 

S.D . of" Test 1 scores 

Observed mean of Tpst <ji scores*' 

* S>D . of - Test 2 scores 

Corre ration of r Tes£ ^2 • with 
Tesfl s-co'res . , " 

Slope of regression ^line-' for 
predicting Test 2 "from Test 1 scores 

Estimation /Prediction) equation t 



»Stai 



Standard error of estimate •"• 

^ Te'st index of estimation 

* » • * 
Significance of the estimation 

. Estimated mean of Tetst 2 score 

J £ff<?ct of Program 

* a Test, index of -treatment effect 

Statistical significance of \ 
treatment effect 



SERVED -GROUP 
• (NGE < 42) 




558 
27.91 
10.07 
35.34 
14.58 

. .18 



■.27,- 



COMPARISON GROUP 
• (NCE> 42)'.. 

225*0 
55. -25 

8.?05 . - , 
52.83 
,14.66 

.89'. 



Estimated /Test 2 s"oore = 3.66- + 
.89'- x* Test. 1 scone-* ' , 



14.35 



12.79 ' 



£<.01 

28.50 



704.999 



35.34 
1(2 8Q5) 



,<4 



- 28.50 
= 5.40 



6.^84 
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l£ |28 |25 



1.25 III 1.4 



ill 

2.0 
1.8 
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MICROCOPY RESOLUTION TEST CHART 
NATIONAL BUREAU OF STANDARDS 
STANDARD'REFERENCE MATERIAL 1010a 
(ANSI and ISO TEST CHART No 2? 
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Table 4 



A Summary of' Regression Anal/sis 
(Model C) data for the £ixth Grade * 



Number of pupils 

Mean of Test 1 scores., V < V K , 

S.D .* of Test 1 scores 

, Observed mean of Test 2 scores 

S.D. of Test, 2 scores 

Correlation of Test 2 with 
Test 1 socres 

Slope <aff regression line for*^ 
predicting Test 2 from Test 1 scores 

Estimation (Prediction) equation ' . 

Standard error of estimated 
Test -index of . estimation " * 
Significance of the estimation 
Estimated mean of Test 2 score 
« Effect of Program 
* Test index of treatment effect 



'SERVED GROUP - 
(NCE < 42) 

c 

• 382 
*^ 28.34- . 
10.34 v 
34.26 
11.97 

. .37 

f 

.43 



COMPARISON GROUP 
(NCE > 42) ' 



a 

2669 



55.71 

8.56 , 
53.62 
13.22 

.55 • 



4 



.84< 



Estimated Test 2 'score = 6.55 + 
.84 x Test 1. score 



Statistical significance of 
treatment effect 



11.12 , 
• • F (l, 2667) = n *' 93 

t 

. E<..or 

30.36 

34.26 - 30.36 = 3.90 
., - i(304 8 ) " 2 ' 41 

p_<.01 V 
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READING STRATEGY PROGRAM 
Cleveland Public Schools 

Teacher Opinionaire 



N=57 



June, 1980 



Selected pupilS in your classroom have participated 
in the Reading Strategy Progrank during the 1979-1S80 
school year. ' We are asking^yqjzr cooperation in the 
completion o£ this opinionaire that we may ascertain 
the impact of this program from the viewpoint* of the 
classroom teacher. liindlV return the opmionnaires 
.unsigned, in- the enclosed envelope, no later than 
Friday, July 11, 1980. Mrs. Gwendolyn Morton 
Division of Research and Development , Room 600-& 



In your opinion what were the major purposes of the Reading Strategy « 
pfogram? ' 

. To improve mastery of reading skills and provide directed practice 

within the classroom; - # 

; i > 

. To reinfdrce thp skills'' taught by the classroom teacher, 

> 

. To motivate learning through successfully learning skilly. 
To provide practice and time to identified pupils. 

i 

What did you do to assist the project's efforts to improve the read- 
ing weaknesses of pupils selected according to the Reading Strategy 
Program'^ criteria? ] 

Introduce lessons and tested and retested for mastery of the- skill. 

. Taught reading daily. 

♦ Encouraged and supported children in the program. 
L , Worked in coordination" vfitfi Strategist to improve students reading. 



. 1 
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In your opinion, hw many pupils, who were assisted by Reading Strategy 
Staff, improved in reading to the following degrees: » 



Very Marked 
Improvement 


Marked 
Impipvement 


Some 
Improvement 


Little 
Improvement 


NO 

Improvement * 


11% 


• 

•44% 


37% < 


7% 


1% 



(N=869 children) 



How many of your pupils who were participants in the Reading Strategy 
Program', reflected positive changes in the following areas and to the 
following degrees : . 

. attitude toward reading 



Very Marked 
Change 


Marked 
Change 


■ Some 
Change 


Little 
Change 


No ' 
Change 


10% 


40% 


41% ' 


I 

8% 


ii 

4 

Z— 



(N=853 children) 
. Increased self-motivation 





Very Marked 
Change 


Marked 
Change 


Some 
Change 


^Little 
'Change 


i ^ — i 

Change 


f 

A 


11% 


33% t 


45% 


10% ' 





' < . (N=854 children) 7 . ?. ^ 

7 Did changes occur in pupils' reading habits which caused you to feel 
' that thfc strategies of this program had been beneficial? 

' Yes 49-S2% ' No 4-8% . 



193 



'APPENDIX' C 



J 



Comments: 



Children who were reluctant to receive special help were anxious 
to go .to the reading strategist. 

Children who would not read independently evidenced more self 
reliance. 

Children Showed improvement in vocabulary, comprehension, and 
other skills that hand been reinforced. 

Students appeared eager to attend the program. ' 

Cliildren responded well to the personalized and indivi3ualized 
instruction provided for them in small groups with the strategy 
teacher. *• 

Students' self concepts and attitudes improved aft?/ having some 
success. - , 

t Students, that lacked trie* motivation for Reading at first, seemed 
to have increased in enthusiasm, ^ 

Children were more excited about reading than before. They 
requested to take more books home. Trade book discussion seemed 
to improve and became enjoyable. * 



What benefits did you receive from this program? 

. Improvement of th'e students 1 monthly growth was inspiring and gratify- 
ing to watch. " * ' 

. Sharing ideas for teaching skills, e.g. varied, approaches to present 
skill lessons and ideas for games. 

. Provides the weaker readers the consistanf reinforcement of reading 
skills the classroom teacher cannot provide. 

. ' Pupil participants mastered their necessary skills much faster and 
taore -thoroughly than they' norj^lly would. 

. Regular lessons progress smoother because weaker readers are*better 
prepared. 

. Improvement in planning skill lessons. ^ 



-198- 



19 4 



m 

APPENDIX C 



What _;Was the extbnt of your awareness" of the diagnostic-prescriptive 
instructional approach to 'reading prior to becoming involved in*£he 
Reading Strategy program? , 

. This approach presented many paractical techniques for reading 
instruction. 

\ 

/ Improvement in the use of terminology to describe the prope,ss A 

. This is a good approach to apply to any subject "area. • 

7 The pre-post test of skill mastery aids the teacher in decision 
making* , , 

\ 

Increased awamess of skills (s.ub-headings) to heirp^ reinforce skills 
necessary. / 

* * ' * 

. The Reading Strategy program has been a practical solution for the 

identified weak reader. v 

. The program expended my« instruction to include the Diagnostic Read- , 
ing Probes. t * 

, t We program-enables served pupils to work more independently after 
attending sessions with the Reading Strategy Teacher. 

The x Strategy program's .concentrated effort and additional instruc- 
tional, time benefits the student. . * 

•\ The progijam has been very successful. 



Wfyat significant changes hive occurred in your instructional procedures- 
since you have become involved with Reading Strategy? 

Acceptance -of other points of view to try other, suggested approaches 

A*definite and sequential plan % £ or teaqhing reading skills. 

Provided , more individualized instructions. * 

* < 

A better understanding *of basic skills and how they should be applied 
to* teach reading. 1 . ^ A - v 

More conscious about completing skills as prescribed. -*C 

Providing additional activities and practice lessors to improve * 
individual students skills. 

Added teacher confidence in teaching the sequence of skills. 
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. Additional awareness of skills needed for mastery and various games* 



? v to reinforce learning 



.5; Improved identification of students needs and applying the prescript 
' tive teaching method to. reach the desired goals! 



Recommendations: . • % . 

. Provide help for students on teacher jifclgement and past low academic 
performance; and not standardized test score? alone. 

• * * # * 

. Recommend the study skills program be continued through junior high 
school. < • • - 



. Smuggest that the Reading Strategist work in a separate room^pth the 
. reinforcement group. 

. More flexiability for the Strategist to review a skill the student 
has not mastered in the sequential reading plan. * . 

9 s 

* 

. Include the nineteen ^specific reading* skills in the Probes. \ 4 
_ Proj^cJ^s very wfc^thwhile anjl should be continued. ^ 



{ 
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^Cleveland Public -Schools 

; Parent Opinionaire ' 

, ■ 1979-1980 

COMPOSITE 'SUMMARY 
N=136 



Dear Parent : . 



r 



" We 'are contacting parents whose youngsters have partici- 

pated in the Reading Strategy Program - during this year. u 



Your chiTd 



has received 



reading help through this program. Would you please help us by 
telling us what you think about this program? Please answer and re- 
turn, to your child's teacher by Thursday, July 17, 1980. * 



* 1. Was your son or daughter in 'this program? Son Daughter^ 



2. What gratie was y our child? 
— : 7 ~ 



:erlc 



«iThe parent of .the project participants responded 
as fori lows «* j t f 



Grade 


Boys 


Girls 




Total. 




6 


' o 9 


. 19 




28 

-44 ■» ' 


* * 


' " 5 


21 








4 


■ 34 


26 




60 

y 




Other 


1 


3 




4 


V " 


Total 


65 

# 


"> 

71 




136 - 

•* 


** 

1 

• 


• 

l • 

\ 


1 






* 

• 




v. 

( • 
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What do you think of the' help, in reading your child received? 

Excellent r-s Good i — i* ! Faix-s^j « 'Little r— i No $ No Response » 
Help LJ Help* 1 —' Help .Help LJ H elp 

6C? or 44% 60 or 44% . 11 or 8,% 2 or 1% ' "*0 3 or 2% 



What did your ghild tell* your about things the, special reading, -teacher * 
did to help make him or her a Detter 'reader? : : ' 

; #* • 

. "She told me* that she liked the special reading teacher and the dif-. 
ferent ways that you helped hey e.g*. reading games and' dif ferent < 
work sheets." t ' ' ** « 

She fras 'most excited about learning how* to take words and sound them 
out for herself. ^ • 

The reading Skills - synonyms, prefixes, suffixes, ffcgt words. These 
skills . helped her to really understand how tp read better. 

« * *■ * 

"Learning how to build words and understating what shej^as .read." 

The. teacher taught^ them how sentences were m^de and gave them a better 
understanding of what's r'ead*. \ 4 # > 

. He said "she helped him to breakdown vords into syllables* He. also 
learned to pronounce words more cJLearly." 

He indicated that he receivejd very individualized attention and 

help in his reading. 

r\ ^ * \ ^ * 

. .Phillip said "his reading teacher pointed out those things to remember 
- the rpain characters, where it takes place, how to pronounce the words, 

and what it is about. ~ 1 

.' "Reading aloud, listening to* tapes, learning vowels' sounds; reading 
comprehension j. earned drawing conclusions, main idea of a paragraph 
or sentence and better understanding of classification." * * 

.* 

What showed you that your child was reading better? 

; "Appeared more interested* in reading books and reads more now. ,v •* * ^ 

. She can tell me what she had read much better; ^he seems to enjoy 
m reading more* ' • ' 

: •They (both children in the program) read much clearer and^faster now. 

I listen* to her read and it is ?0 much better. Shejdid need help and 
she* got it. ♦ 

* 

. '.'Child became' more, interested in books, newspaper, and various signs 
and billbpards." ' " 



\ 

\ 
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. She got books from the library to read without me telling her, and k 
she would read to'me, afterwards I would ask her questions. The „ 
understanding and comprehension impi ; oved. -* ■ ^ * 

" , Tftp report c^rd' improved. T - * 

. fie became more interested in reading and -began to s£t down and read to- 
* me and to the library for more skills. * 

. He is more interested* and he ask people to listen. 

! Improvement in .vocabulary , knows more'vyords and pronounces tl)em better. 

_ — / 

. He's reading at home to his sisters. 

* — * * 

Did you attend any of these meetings about reading? 

; ? 

* 

Yes 72 or 55% No 60 or 45% r . - % - 

.* i . * 

Conferences -with special reading teacher? * , 

* • 

Y'es 65 or 54%* No 55 or 50% * % • 

Workshops to learn how, to help child at-home? , 

Yes 65 or 54% No 57 or 46% 

0 Does your child read better now? ; 9 • . • x 

^Yes 130 or 96% No 2 or 1% No Response 4 or -2% 

H ow do you feel about your child's reading now? 1 
— ■ " • 

. My child- is reading better due to her attending the reading program. 

. We feel very good about her progress in reading-. ,1 hope she can be 
in the program next year. ^ , • * V 

. I am very pleased. • * . 

t I feel she is making progress in her heading, and with this program 
she yill get better. I & 

. She is beginning t:o understand more of what she is te^dii^. 

. . { ' ( \ 

. We' feel very .good about her progress in reading? she^ helps her 
sister and brother now that she reads better: ^ ^ 

I am impressed with. the confidence he as showing. 

* % I feel the Reading Strategy Program was excellent. 

. i *r 

. The program needs to continue. % 



1+ % * 
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',. Good - I think *this program is good for children like. Keith who.dGes 
need a little more help in reading. * V * 

, Do you help your child vjlth reading at 'home? * * 

Yes 110 or 81% No 19 or 14% No. Resporfse 6 or '4% * * 

Does someone else in the family help your child with readimg a^t home? 

Yes 81 or 59% No 49 or 36% No Response 6 or 4% 



Would you like the Reading StVategy Program to continue to help your 
child with reading? 

s - ■ 

Yes 133 or 97% ' No 2 or 1% No Response 1 or .07% 

General Comments 

. • . The Reading Strategy Program is an excellent one. I think it 
should be continued in the public ^schools. 

, • * 

. The Reading Strategy* Program is excellent. 

* •* * 

! I liked tjie Reading Strategy Program because it helps children 

read better and understand what is being read. 
"/ i ' 

/. I. would like for tlie Reading Strategy to continue, not' only did 
* ' it help my child, it helped so many other children. 



We need more programs of this kind to be continued'. 

The special help is very good for the working parent who has 
little tisie to give extra help to the child who ds having dif- 
ficulty, reading, * h 

The Reading Strategy Program should continue into junior high school. 



APPENDIX D (Cont'd), 
PROGRAMA ESTRATBSIAS EN IA LECTURE 
ESCUELAS PUBUCAS /DE CLEVELAND 
COESTICNARIO PARA LOS 'PADRES 
1979-198.0 



9 Junio, 1980 



• « Estimates Padre^: 



Estanos ccniunicandonos con los. padres de los -ninos que han 
participado en el. Program Estrategias en la lectura durante este ano, 



Su hi jo (a) ^ * ha recibido 

ayuda en la lectura por medio de^este programa. dPodrla usted ^ ; 
ayudarnos deciendonos qdS piensa usted de este programa? Haga el ' * 
favor de contestar las preguntas que aparecen aba jo y devolverlas al 
maestro ja) de su hipo (a) en o antes del jueyes'lT de julio de lft&Q, 



1. 
2. 



cEstuvo su hi jo o hija en este programa? 
£En que grado estaba su hi jo (a)? 



o 

J*l Hi jo 



Hija 



3. £Qu£ piensa usted de la ayuda que su hi jo (a) recibi6 en la 
lectura? * fa* - • 



Excelente 

1 J 



Buena 



Regular 



Poca 



Ninguna 



4. '£Qu£ cosas hizb el maestro especial de lectura para ayudar a su 
■ Itrjo a ser pn mejor lector? v ^ * * 



4- 



5. ' <?Qu£ cosas le dartuestran a usted gue su hi jo esta leyendo mejor? 
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6. 'dEstuvo usted presente a algunas de esta§ reuniones sobre la 
lectura? , ^ 



r 



cTuvb alguna confer encia con el maestro especial de la lectura? 

Si' |— j No £— ' 



£Asisti6 usted a algunos tialleres para aprender coipo. ayudar al 
nino (a) en la casa? «. .« 



Si 



7. iliee su hi jo (a)\nvejor ahora? 



Si 



No 



'No 



S3*. 



8/ dC&no se siente usted ahora- acerca.de la lectura ^"de su hijo (a)? 



J 9. cAyuda usted a su hijo Ca) a leer en su csysa? . 



-Si 



No 



10. £Hay algun'otro mietffcro c?e su familia que ayuda a su hijo (a) con 
la lectura en su casa? * ^ B 

Si I | -No | | % 
cQuien? . ' 

11. cDesea usted que el Programa de ' Estrategias en la lectura continue 
ayudando a su hijo (a) en la lectura? 



9 

Si 



- No 



Ccmentarios 



GraciasT*por ^contestar las preguntas. # DevuelvaJ.o a la Maestra de # 
Estrategias en la Lectura. y * t , 



JZ/10/80 
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Appendix e 
reading strategy program 
cleveland public^ schools 

'• • ' 1979-1980 • 
. STAFF PERCEPTION SURVEY 



N=63. 



• 



^ \ Your role in' the Reading Strategy- program is of major importance 

'to pupils' success. Please respond*tfc the items on this survey. Return 
the 'completed form* to Gwendolyn Ntortbn, room 600-S Division of Research 
and Development no later than Fr:|fiay, July 11, 1980^ * ' . 



l. % What is your assignment in the Reading Strategy program? * 

Strategy Teacher 53 w \ ^Speech Therapist 1_ * * ^Consultant ^7 

* X- • 

Psychologist 1 Parent Coordinator 1 Other _ 

Z: What have been your [major responsibilities this year? 

. To teach Probes follow-up lessons to 4th and, 5th graders ,and 
C1SSS to 6th grade" students who are eligible. t 

. To -teach specific skills to small stategy groups, pre and'post 
- .t^r'tAese skilly, am develop follow-up skill lessons. 

3. 'How many inservice meetings have yau attended? 

1 . Average, of eight monthly meetings. 



Comments: 



. Each inservice meetings wtfs well planned* 

Gu«st speakers were interesting and helpful with reading ideas. 

Provided opportunities to »share ideas and materials*- . +' 

". Provided consistant 'directiofl for program policies and examples 
, of program record "keeping procedures unique in Reading Strategy. 

4. What did. you consider the most meaningful contributions of inservice/ 
' staff conferences to your effectiveness in this project? \* 

* * 
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Constantly introduced to new techniques and materials. 
Responsibilities, procedures and program were 'explained carefully, 



.updated, frequently. 
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Opportunity t& make game^ and skill lessons, the sharing of 
ideas with other' Strategists. ' 



.* Opportunity to observe demonstration lessons. 
How did your role as'^Nt the project to achieve its objectives? # 

. Students progressed through ' s'teps of program and showed improve- 
ment in reading skills. 

• * « » * 

, Working with small groups and specific; skills, I was able -to 
, pinpoint individual problems* and h£lp a great majority of 
students experience success in basic reading skills. 

i • 

. Following the objectives and guidelines set forth in the program* 
f and ^ihejing" to them. 

1 . Student pre-post scores improved considerably. 

What did the Reading Strategy Program do for pupils? 

.' It gave them a foundation with which to build upon; also .develops 
a process to use for future application. * • 

. ♦ It provided motivation for pupils who were reluctant readers; it 
gave poor readers extra time to work at improving skills. 

* It allowed the chilren more individualized reinforcement* in 
reading skills. 

. Pupils wfiS orft^n lag behind the class were given the ijjdividual ^ 
instruct ^djffBtjfr and over again, so that they could make a smooth 
trans itior^|PI one skjll to the next. ^ 

It d^veloped'an awareness that through reading comprehensively, 
^ reading can be a pleasure^ • _ 

•* if. Children were strengthened ip their reading abilities, through 
I* l con9entr^tion on skills improvement. 

. Provided a planned sequential method of reinforcement and support 
for small groups of students with reading difficulty. 

» 

. Gave students individual attention and added lessons in reading - 
skills. 
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'APPENDIX E (Cont'd) 

What did the Reading Strategy Program do for teachers? 

, * Aided teachers by providing small group and Individualized 
reinforcement to eligible students. f 

. Shared different approaches in hewing children. ^ j 

Provided specific l'essons to teach ^children and wojksheets for 
* practice. • ^ 

. -Supportive help for those student/s who needed extra hel-p. 

Provided a diagnQstic and prescriptive tool, lesson plans', foil 
• up lqssons, extending activities, plus a supportive s^aff. 

. AidecPteachers by reinforcing and reteaching reading skills in" 
a -sequential order. * 

Please feel . free to include recommendations : A 
: v to .improve project operations 

. ' permit Strategy teachers to work outside the classroom 
with -the group of pupils. 

. More in^ervice time for groups^of only new Strategy teachers. 

. . provisions for ins.ervice meeting(s) of classroom teachers at a 
the beginning of the school year. 

. provisions for sufficient practice 'activities and materials 
to help every child -acquire a full gra^p and clear understand- 
ing of the reading skills. 

. reassess the time required for record keeping, lesson preparation 
and developing reading game act^ities. ^ 

. innovate workshops geared toward Strategists 1 who service Atth, 
grade pupils . 

. For greater pupil growth 

return syllabication unit in fourth grade. 

continue to stress >tffall group reinforcement with students. 

provide sufficent consumable supplies. 

revise Probes to be more appropriate to specific grade levels. 

emphasize close collaboration betweeri classroom teachers and 
reading strategist. 



* ■ ' ..Append joc e (cont f a) * - 

encourage building meeting for classroom teachers receiving Reading 
Strategy service to point oyt the benefits to pupils and teachers. 

* * 
continue to encourage parent participation/ ^ 
* < ' m 
add more t:han oxie teafcher to^ a building where the eligibility 
list is larger. v f * 

m 

\ * 
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. ' RESIDENT TUTOR -PROJECT 
'19*79-80 Title I Evaluation 



PURPOSE AND /OVERVIEW : * 

The purpose of the project is to provide eligible pupils in grades 
1-6 -with; remedial reinforcement specified skills in reading and/or mathe- 
matics and to provide them with the opportunity for d, personal association 
with an adult or college student- Pupils., identified by classroom teachers 
as needing extra help and who meet project eligibility criteria are tutored 
on a regular weekly schedule by full, or part-time Resident Tutors, who work^ 
under the supervision of three consultant teachers- Tutors work with one ~ 
to two students at a time outside of. the regular classroom for apprbximately 
thirty minutes per day, up to five day^-per week. Tutors also "receive pre- 
* service and inservice training. Priority service is given to students who 
are eligible for participation in one of the other Title I Reading or Mathe- 
matics projects but who are not served by them. 



SERVICE SUMMARY 

Number of Pupils Se'rved ': 2,659 ■ Grades Served ; 1-6* 

. ~\ 
< dumber of Schools : 61 Public ^Years in Operation : 12 

' (See Appendix A) 12 !Non-Public * m 
- 73 Total 

Staffing : 1 Project Manager* (PT) 

3 Consultant Teachers (FT) 1 
83 'Resident Aide Tutors (FT) 
19 Resident College Tutors (?T) 
• % 1 Clerk (FT) * 

\ Total Title I Expenditures : $702,902 Per Pupil' Cost r $264* 

— T~ 5 T^v^ • "•' (School Year) 

OBJECTIVES AND OUTCOMES ■ j*, • ' 

. Process Objective 1: * Fifty-eight full-time educational aides and up 
to 52 part-time college students will be hired as tutors to be assigned 
to up to 56 public and 20 non-public Title I elementary schpols. 



* Title I funds in addition to General Fund per pupil expenditure, 

1 ^ 
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Outcome : * This objective was achieved. 'Examination of project 
records indicated that during the 1979,-80 school year 83 full-time 
adult aides- and 19 full-time college students were hired and served 
as» tutors in 61 public and 12 non-public schools.- (College students 
worked^ only during the" summer.) Closer analysis showed that, al- . 
t though a total 6f 102 aides and college students were hired during 
the year, that number was not employed at ahyrgiven point in time. 
Similarly, although the project served '3. total of 73 schools, that? 
many were not served a^the saise time. Data showed that of the 
73 schools .served, 13 or 18$ received project services for one 
semester or less. Table 1 shows' the number,* of tutors employed 
arid the number of ^chools being served at five arbitrarily selected 
points in time, during the school year. 



Table 1 
* , f 
Numbers of ^Tutors and»Schools in the Resident Tutox 
Project at Five Points During the School Year 



Time of Yepx 




— 4 — — . - 

, Tutors 
Employed 


Schools 
- Served 

• 




September 
January \ 


— ^ — 


» » 
48 

• 

55' * 


48 


v 


March 




• 69 * 


.66 




May 

t 


* 


•,74 ' 


67 




July* 




73 


64 





* A teacher strike* closed the Cleveland Public* Schools 

from mid-October to early January. The school year . * 

was extended until July 23,*; 1980. ' 

Records showed that the variation in numbers of tutors and Ichools 
was due to tutoo; resignations and transfers, the late hiring 
of tutors for some schools* and adjustments in the concentration of 
services based on updates in Title I enrollment data. 



Process Objective! 2 ; All project assigned tutors will attend at least 
one pra-servic* and monthly inservice training wofkshops, conducted 
by project staK and/or consultants. 

. Outcome : This objective was achieved'. Interviews with projeet 
staff and examination of project records showed that a general 
orientation session was held in early October for all 50 tutors 
k employed by that date. As additional tutors were added to the 
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% staff, orientation to Project procedures was conducted in individual 

o^ §mall /group sessions. Records show that following the orientation 
session; a total of six additional inservice sessions were held 
f throughout the year at the approximate ratfe of cme per month, begin- 

ning in February, l£80. ££chools # were closed _from mid-October tor 
, early January due to a teacher strike.) The inservice workshops 
dealt with topics such as regard-keeping ^procedures, test adminr 
♦ istration, tutoring techniques in reading and math and exchanges 
*r of tutoring ideas. In addition, ,two of the workshops were devoted 

^ * to demonstrating tutoring techniques for parents of tutees. 

F * * 4 

On a questionnaire administered to a sample of 57 tutors* in July, 
, 1980, the inservice workshops were given Overall, ratings#of Effective 

to Very Effective by 96% of the tutors. Ratings of individual work- 
shops ranged from 92% to 98% in^the Effective 2nd Very Effeetive % 
categories. When asked whether additional areas needed to be cov- 
' ered in the training workshops, 40% of the tutors replied -in the 

affirmative. "Requests were varied. Tutoring ^techniques for frac- ^ 
4 tions, methods of working with # parents, more frequent /sharing of • 

ideas among tutors and w^tys of improving student' attitudes were • * 

. . • among the most frequent requests. A summary of responses td the 
° f tutor questionnaire may be found in Appendix B. 

\ N 

. , Process Objective 3 : Re$£dfent. Tutors will be assigned to f schools at 
i specific request of school administrators }on the basis of educational 
•needs, as' indicated by the poyerty inde* and ' enrollment of education-* 
ally disadvantaged pupils. ^ + v 

. Outcome : y This objective was achieved. A list of schools* served by . 
the project may be found in Appendix A. Examination of project re- ^ 
cords. -and reference to a rank carder -list of schools by their poverty 
index* indicated a rough correspondence between poverty level and 
level of tutoring^ervice. Because the available tutors were-spread 
i rather evenly among the schools served, a heavy concentration of 

service in the schools highest on the poverty rank list was not'$yi4 > 
dent. However; when* the rank list of 9 schools eligible for^Title I 
service was divided into halves, it was found that the^igh poverty 
hal£ of the list contained 3&of<,the 61 -public schools (62%> parti- 
cipating in the Resrdept Tutor Project. Further, the high poyerty 
half of the list contained* only one school which did not receive 
project services, whereas the low poverty half contained 17 such 
schools. Binary, of the 11 public_achdols which received Resident 
Tutor service for "only one semester v oiNless, 8 or 73% were in the 
lowest poverty third of the schools, served. These ,data indicate 
that priority was given to providing proj.ect services to schools , - 

with the* greatest need as defined by poverty index. . • 



> 



* Percentage of students in the school who are eligible for free or reduced 
price lunch; / # * 



*9 



o 
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process Objective 4 : Tutors will work with groups of 1 - 2 children 
at a time, providing reinforcement instruction in specified concepts 
# and/or skills which are the instructional emphasis of the project, 
and whifch have been identified as high priority needs of children in 
priority schools. * 

. Outcome : This objective was achieved. Examination of a random " 
sampje of 124 student records indicated that 60.5% of the tutoring 
assignments. were for specified mathematics akills and 39.5% were 
for specified reading skill's. According to the* responses of a 
sample of -57 tJttors to a questionnaire administered in July, 1980, 
• tutoring sessions ranged' from less than 1^ minutes to oyer 30 min- 
utes, but 87% weij<fjtetween 20 and 3a minutes in length.. Teachers 
(N = 29) respondfa?§5 0 ' a questionnaire administered in July, 1980, 
reported that children receiving project services were tutored 
from 3 to 5 days per week with the median*£ging 5 days. Summaries 
of responses to the tutor and teacher questionnaires may be found 
in Appendix B and Appendix, C respectively. 
**' ' > * * 

Table 2 shows the percentage of tutoring assignments that were made 
in each reading or math skill area. - ' , 

# v Table 2 

Percentage of Tutoring Assignments by^Skill Area* *j 



Math, Skills 



Percentage 



Reading Skills : Percentage 



#dd/Sub Facts 
Mult/Div Facts 
Add/Sub Computation 
Mult/Div Computation' 
Problem Solving 



i- 



15% 
15% 
17% 
13% 



2% 



Alphabet **r 2% 

Vocabulary." " • 13% 

Auditory/ Visual Perception' 45.%, 
Long/Short Vowels ' 13% 
Syllabication \ 2% 

Spelling 4% 



TOTAL 



62% 



TOTAL •• 



38% 



Process Objective 5 : Fifteen of the full-time educational aides will be 
assigned to Pareift Resource Centers in 15 Title I schools and will devel 
op parent involvement activities in addition" to tutoring. . At least S0% 
of the parents of pupils tutored by these aides will visit the Parent 
Resource Center at least once to receive explanations of the tutoring 



procedures and materials, be* apprised of the progress being made by <v 
their child, and/ ox learn tutoring techniques to be use4 at hjjne with 
the pupil! ^ , 

. Outcome : This objective was achieved^ — Examination-_of _pxOTect_re_- . __ 
cords showed that Parent Resource Centers with full-time tbtors were 
established in 15 of the 61 public schools served by the project. , 
Of the 527 students served by these 15 tutors, the parents of 286 
or 54% visited the Centerls at least once. When the visitation, data 
.were examined for each Center separately, it was found that tHe per- m 
centage visiting parents ranged from 7% to 88% ^ Nine of the ,15 
Centers mfct the criterion set by the objective. The records shot* 
further that from zero to 27 parent meetings were hpld at the Ceriters. 
A total of 111 such meetings were held with the median number per 

Center being 5. At. least one meeting was held at 14 of the 15 Centers. 

• > 

Product Objective'! : After a minimum of 30 tutoring sessions of 20 to 
30 minutes on a specified reading concept and/or skill, 50% of a sample 
of participating pupils will show a gain of 15% or ipore on a Project- ^ 
constructed test' measuring mastery of ^that skill or cpncept. ' * 

\. Outcome : This objective was achieved. Skill tests developed b/ 
\ project staff for six reading skills were administered to tutees 
on a pre-post basis. Tutees werejadministered only those tests 
appropriate 'for ; the skill on Which Jthey were being tutored. Exam- 
ination of the test Scores for a random sample of 124 students who 
completed 30 or more tutoring sessions in reading showed that 92% 
achieved a pre-post gain of at least 15%. When the results were : 
analysed separately for each skill area, the percentage achieving 
a gain of 15% or greater was found to range from 67% to ^100%. The 
size of the gains achieved by the students averaged 43% from pre 
to post testing. A 'summary of.,the pre and post test performance 
on the reading skill tests may be found in .Appendix D. 

- . ; , i ; 

' Product Objective 2 ; After a minimum "of 30 tutoring sessions of 20 to* 
30 minutes on a specified mathematics concept and/or skill, *50 percent 
of a sample of participating pupils will show a' gain of 15% or more on 
a Project constructed test measuring mastery of that/ concept and/or 
skill: 

. Outcome : This objective was achieved; Skill tests developed by pro-' 
j^ct staff for five mathematics skflls were administered to tutees 
on a pre-post basis. Tutees were Administered only those tests ap- 
propriate for the skill on which tKey were-being tutored. Examination 
of the test 'scores for a random safiple of 124 students who completed 
30 or more tutoring sessions in mathematics showed thiit 95% achieved 
a pre-post gain of at least 15%. When the results were analyzed 
separately for each skill area, *Rhe percentage achieving a gain of 
, 15% or greater was found to range from 94% to 100%. The size of the 
gains 'achieved by the students averaged 43% from tte pre to the po£t 
testing. A summary of the pre and post" test performance on the math- 
ematics skill tests may be found in Appendix D. 




. Product Objective 3 : After a minimum of 30 tutoring sessions of 20 
to. 30 minutfes each of specified reading skills, the mean post-^est 
NCE score will be 7 units higher than the mean pfe-test score for a 
^\ sample'af pupils in grades 4 through 6 using the subtest of the St^n- 
- ' jforcLDiagnos tic; Reading Test appropriate to the skill being tutored. 

*• * 

' \ Outcome : This objective was achieved at, grades 4 and 5 but not at 
grade 6. The Stanford Diagnostic Reading Test was administered in 
October, 1979 to all students in grades $V6 as part of the city- 
wide testing program. This administration- served as the pre- test 
for Resident Tut or 4 Project [students . Following the completion of 
tutoring in a specified reading* skill 1 , each tutee was again ad- ' 
ministered the Stanford Diagnostic Reading Test by his tutor, but 
only *the subfes't that corresponded to^the skill tutored'! ffre and 
post scores, were converted to NCE scores using fall spring* 
nonfls respectively. "lamination of the pre -and post NGE means 
showepl that at gradeV4 the mean gain was 10.3 and jat grade 5 the 
mean gain was 17.4, both of which exceed the criterion of 7 points 
set in the objective % . At grade '6, however, there was a mean Loss 
of 3.6. Individual subtest scores are detailed in Appendix E. 

In order to illustrate where the students served by the Resident 
Tutor Project stand in relation to the national norms, Table 3 
shows the percentile ranks of the average pre and post scores, > 
achieved by the students who topk each of the subtests of the 
Stanford. 



Table 3 



i 



Percentile Rank on National Norms of Mean Pre &nd Post 
Scopes on Subtests of Stanford Diagnostic Reading Test 



Subtest 



N 



Percentile Rank 
of Mean Piffi 



Percentile Rank 
of Mean Post 



Auditory Vocabulary . 
Structural Analysis 
Phonetic Analysis 
Auditory Discrimination 



13 
5 

10 
1 



2177 
36.6 
18.9 
18.4 



36.0 
56.1 
38.7 
*23.8 



5 K Auditory Vocabulary 
Structural Analysis 
Phonetic Analysis 



16 
10. 



Auditory Vocabulary 
Structural Analysis 
Phonetic Analysis 



• 10 




'46.8 
7.1 
' 33.5 



14.3 
6.3 
18.4 



Table 3 shows that on the pre-tests the average scores of children 
served by the' Resident"* Tutor Project were mostly ijfr^ie lowest 20% 



\ 

<of children nationally. The expectation is that without project 
services, their scores would remain the same relatiVs/to Children 
nationally. ^.The results show that at- grades 4 'and .5, substantial 
growth beyond' what would be expected was achieved by most groups 
tested. At grade ,6 the results indicate that the children tested 
fell further behind on two of the three skills tested. Despite 
/ 1 the progress noted, most gToups tested^remained in the lower ranges 
/ of scores nationally '(with two notable exceptions). ' The small 

numbers of children- for whom test scores are available suggest that 
that caution be exercised in interpreting these results. 

t 

ADDITIONAL FINDI^S ' ^ 

Additional information rfelated to project operations is summarized 
below. The information was derived from surveys completed by samples of 57. 
tutors and 29 classroom teachers. Tutor questionnaire responses are detailed, 
in Appendix B and those -of teachers are located in Append^: 0. 

. Forty- five percent of the tutors surveyed .-reported that at least 
some of their pupils didnot appear to meet the Project eligi- 
bility criteria. This represents a 12% increase from the pre- 
vious year. Thirty- four percent reported that such pupils con- 
stituted between 1% and 25% of their tutoring load and 11% 
reported that £uch pupils made up more than 25% of their tutees. 
Questioned as to why students were tutored despite not meeting 
eligibility requirements, the »o|t frequent responses from 
tutors were that in The teacher's 'judgement the student needed 
help and sometimes test information was no|* available on new 
students. j » 



r 



Although all classroom teachers reported using various kinds of . 
test information as part of the criteria for referring pupils 
\~S .for tutoring service, pupils 1 classroom performance remained 
the single most frequently used reason for referring pupils. 

. "Jhe number of teachers served by each tutor ranged from 2- to , ^ 
14 with a mediim^of 5. 1 # 
* * • . *\ ** 

. The total' number of pupils served by each tutor ranged from 16 

to 88 with a' median of 33 for the Educational Aide Tutors and ' * 

35 for the Parent Ceivter Tutors. According to teachers, a 
median number of 7 children were served per classroom. 

. Previous experience working in the Resident Tutor Project, was 
reported by 61% of the Educational Aide Tutors, and 88% of the 
Parent Center Tutors. 

- , - • . When asked if classroom tearchers clearly identified the specific 
* skill to be tutored when a child wa|s referred for service, 96%, 
of the tutors reported that thi? was usually' or always the case 
in reading and 93% reported that the skill was usually or always g 
I identified' in math. 

. One hundred percent of the tutors savveyed reported that the 
♦ * • Resident Tutor Manual wa£ at least Somewhat Helpful as a source * 
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of tutoring ideas. The manual was rated as Very Helpfui by 
§9%. Asked if* the manual needs improvement, -23% of the tutors 
replied in the affirmative. The most frequent suggestions .were 
to include more activities for tutors to use with pupils and 
t* improve the Resident Tutor Skill Tests. 

A total of /80% of the tutors reported that they, held conferences 
with their classroom teachers once a week or more frequently 
to discuss tutees*. progress. Meetings that frequently were 
reported by~74 % % of the teachers. * 

^. • * 

Forty-one percent o£ the teachers ^JJiprted being .able te actually 
Observe tfteir tutor at work more frequently than once every two 
weeks, and 65%. reported that this was enough to, enable tjhem to 
adequately monitor the tutor's work. Eighty- three percent re- 
ported that they would permit the tutor to, work in the classroom 
rather than take the tutee to another^location as is the case <. 
now. Those that do 'not want tutors* working in the classroom 
cited >the distractions and lack of proper tutoring atmosphere ' . 
as the primary reasons. 

Tutors were generally highly' satisfied with the support provided 
by their project Consultant Teacher. Eighty-nine perpent re- 
ported that their Consultant Teacher had demonstrated tutoring 
techniques w^Lth pupils, and of these, 90% rated these demonstra- 
tions as Very Helpful. Eighty- two percent of the tutors reported 
that the Consultant Teacher service did not need to be improved. 
The most frequent suggestion for improved Consultant Teacher 
service was that they increase* .the frequency of their visits. 

Children were occasionally withdrawn from tutoring service by 
10% of the classroom teachers. In 75% of these cases service 
was terminated because the, tutee had achieved skill mastery*? 

Classroom ^eachers identified! the most valuable features of the 
Resident Tutor Project as academic improvement, individual at- 
tention to tutees and reinforcement of classroom teaching. 

^Teacher suggestions for improvement in the project centered on 
«a perceived need fpr more tutoring Service and a need to' serve 
•some students not on the eligibility list. 

In addition to the parent involvement^ /activities conducted by 
the tutors assigned to tkaJ^areifflfe^^^^ the protect manager W 
reported that the ResidentWutor Project also recruited a 20 
member Parent Advisory Connjiittee whicli met mbnthly to provide 
reafctionj and advice regarding project operations. Further, a 
series of four project-wide parent Workshops were held during 
the school year^ Attendance ranged from .20. to *L68 parents. 
Jhe workshops covered such topics as general orientation to the 
Resident Tutor project, student assessment and selection pro-* 
-cedures and home-tutoring techniques. 



♦ 
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SUMMARY. AND CONCLUSIONS > ' • • ' 

1 • * <• T ~ ~ ^ 

v In" its twelfth year of operation the Resident Tutor Project achieyed 
all of \ its process objectives and tw6 of its tlv£efe product objectives. The' 
third product objective was achieved at two. ofj^ree. grade levels. The 3at^ 
indicate that despite a shift from a full-time to a >art-time project manager 
(original manager lost 'to retirement) .^nd the disruption of a 12-week teacher 
strike, prdject services were delivered, essentially as proposed/ 5 The project 
directly addresses- identified academic needs of its student clientele, an<Lis 
.perceived as valuable by ttie teachers of these students. 

* v 

The anticipated improvement in student performairce levels was • ( 
_:hieved on the Resident Tutor Skill Tests in*reading and. mathematics and on t * 
the Stanfprd Diagnostic Reading Test at grades 4 'and .5. /At gTade > 6 student 
performance did not appear to 'benefit from project services, pxtd in fact, 
declined somewhat. 

Although tutors reported that the majority of the students they 
tutor did meet the project eligibility requirements/ a sizjable minority 
(45%) reported that at least some of their students were notion the project 
eligibility lists. - This problem has been reported/ln^revious years, but 
seemed to have increased in severity in the 1979^60* sgnop^- year. ^ 

Recommendations for future operations of the Resident Tutor Project 
include the following': i ~ 

a. The materials and procedures used with gra&fe*6 students should 

be examined to attempt. to determine the reasons for the lack 
w of apparent impact at that grade leve^ as measuj&4 by the 
• > 7" Stanford Diagnostic Reading Test. /" ^ , 

•b. Measures should be taken to insure that students served by the 
project*are those who meet the Title I criteria. This" might 
* 'include increased emphasis on the topic^of eligibility during 
inservice sessions for tutors' and increased communication to 
- teachers aricf principals regarding the need to adhere to the 
eligibility 'guidelines? v v 

c. If the* level of funding permits, the number of tutors should 
be increased So that each eligible schQol will have the services 
of at least or\e tutor. * ' 



\ 
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APPENDIX A 

Schools Seized by Resident Tutor Project. 



PuSlic 

Alfred A. Benesch 
Andrew J: Rickoff 
, \ Anthony Wayne 
\toton Grdina 
Bolton 

.Boulevard 
^Buckeye-Woodland 
- 'Captain- Arthur Roth 
Case 



Charles Dickens 



Charles H. Lake 
Charles if Chesnutt 
Charles ^Orr 
Chesterfield' 1 
Corlett 

CraTiwood . 
Daniel Morgan . 
Dike v / 
East Clark } 
East Madison 



Eraile DeSauze 
p Forest Hill Parkway 
George Washington Carver 
Giddings t 
Harvey Rice 

Hazeldell 

Henry /Longfellow 

Hicks 

Hodge 

Iowa v -jMaple , *, 
* » t > 

John.D. Rockefeller „ 
' John Raper 
Joseph F. Landis' 
Kenneph W. clement . 
Kentucky j m 

Lafayette 

Lohgwood - ^ • 

Louis. Pasteur 
Margaret A, Ireland 
Mari-on-Sterfing^ ^ 

• * «. 

' Mary B. Martin' 
Mary M, Bethune 
Miles 

Milps Park " . . 
Miles Standish v 



; zi7 



Moses Cleveland 
Mt, Auburn 
Mt. Pleasant' 
Orchard 

•Paul L. Diinbar 

Paul Revete 
Robert Fulton * 
Scrantpn^ 
Sowinski 
Stephen E. Hdwe 

Treinont 
Union 
Wade Park 
Walton 1 
Waverly 

Woodland Hills 



0 



Non-Public 

Mount Pleasant Catholic 
Our Lady of Peace 
St. Adalbert $ 
St. Benedict 
^St. Francis 
St. Joseph Franciscan 
St., Malachi 
St. Michael - 
St. Philip Neri 
St. Stephen 
St. Timothy • 
Urban Community 
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APPENDIX B 

' * ' RESIDENT TUTOR QUESTIONNAIRE SUMMARY 

N = 57 

Dear Resident Tutor, # ' < < 

The Cleveland Public Schools is gathering information for a report 
on the Resident Tutor Project* Your answers to the following questions wilT 
help us prepare the report and make Uec^isionSj about improving the 'program. 
Please answer all of the questions compretely and frankly. You need not sign 
the questionnaire » . • 

.k 

Please use the attached envelope to send your completed questionnaire 
by WEDNESDAY, JULY 16, to the address below* (Use- the school mail if you work 
in a public school). * 

Derek B. Taylor. 
* Division of Research and Development 

Cleveland Public Schools 
1380 East 6th Street 
/ Cleveland, Ohio 44114' 

TUTORS RESPONDING - 57 . 
** 

Educational Aide Tutor = E.A.T. 
Parent Aide Tutor = P.A.T, 

■ • . \ 

1. In addition to' tutoring, are you responsible for a) parent resource center 
in your school? Yes = 28.1%. No = 71.9% 



2. How many pupils have you tutored 


this year? 








• 


Average 




Median 


Range 




N 


E.A.T. 


35.7 




33 


*16-88 




37 


P.A.T. 


37. r 




35' . 


19-63 




15 


Total 


36.1 




33 


16-88 

• 




52 

-* 


3. "On average, 


how many minutes per day do you 


tutor an individual pupil? 




15 or Below 


16-20 


21-25 


26-30 30 


§ Above- N 


E.A.T. 


2.6% 


10,3% 


25.6% 

i 


58.9% 


2.6% 




P..A..T. 


0.0% 


6.3%' 


25.0%' 


^68.7% 


0.0% 


16 



Total 1.8% *9.1% >2S<SV . ~61,8% 1.8% . * SS 0 
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APPENDIX B (Cont'd! 



Counting this month, how many months have you been employed as a Resident 
Tutor this year? 



Average 


Median 


Range 


N 


s 


.E.A.T. 6.4 


7 




1-11 


41 




P.A.T. 8.0 


8 




4-11 


' 16 




Total " 6.8 

/ 


'"/ 8 ' 




1-11 


57 




Have you worked in tlve Resident Tutor Project before this year? 






Yes 


NO 


' N 






> 

E.A.T. 


60.9% 


39.2% 


• 

. 41 




• 

* 


P.A.T. 


87.5% 


12.5% 


16- 




Tota^ 


68.4% 


31 . 5% 

* * 


57 






*• 

The Resident Tutor Training Workshops yoy attended covered several topics. 
How effective were each of tl^e following workshop topics in preparing you 
to work as a Resident Tutoir? 

Very, * Somewhat Not 
Workshop Topics Effective Effective Effective Effective 


a. Completing Resident 
Tutor Project forms 
and records 


E.A.T. 
P.A.T. 


65.9% 
75.0% 


29.3% ■ 
25.0% 


4.8% 
0.0%" 


0.0% 
0.0% ' 


Total 


68.4% r 


2&rt% 


a 

3.5% 

* 


0.0% 


b. Administering tests 


E.A.T. % 


82?9% 1 




0.0% 


0.0% 




P.X.T.' 


75.0% 


18.7% 


6.3% 


0.0% 




Total 


80.7% 


1-7.5% _ 


• 1.8% 


0.0% 


c. Tutoring techniques 
for reading 


E.A.T. • 
P.A.T. 


67.5% • 
68.7% 


30.0% 
*31.3% 


2.5% 
0.0% 


0.0% 
* 0.0% 




Total 


67 . 8% 

4 


30.4% 


1.8% 


0. 0% 

1, 4 


d. Tutoring techniques 

for math 

* # 


E.A.T. 
P.A.T. 


65.9% 
75.0% 


31.7% - 
25.0% 


2.4% 
0.0% 


0.0% 
0.0% 




Total 


68.4% 


29.8% 


(.84 


• 0.0% 


e. Shading tutoring 
ideas amAng tutors 


E.A.T. 
, P.A.T. 


82.9% 
37.5% 


12.2% 
50.0% 


2.4% 
12.1% 


' "2.4% 
o..o% 




Total 


70.1% 

t 


22.8%' ' 


5.2< 


l.'8%. 

ft 
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APPENDIX B (ConiM) 




Overall, how effective were the Resident TutCH^J^aining Workshops in pre- 
paring you to work as a Resident Tutor? (Check one) r 






Very 


* 


Somewhat 


Not i 




Effective . 


Effective 


Effective 


Effective - 


E..A.T. 


72.5% 


25.0% 


2.5% ' 


0.0% 


P.A.T. • 


'■ 68.7% 


25.0% 


6.3% . 


0.0% 


Total 


71 .4% 


25.0% 


3.6% 


0.0% 



40 



L6 



56 



Are there any additional jareas you think need' to be covered in the training 
workshops to increase your tutoring effectiveness? 





Yes 


No 


N l 


• 

E.A.T. 


35*9% 
^fr.0% 


64.1% 


39 


P. As J. 


50.0% 


16, 


,<s5Total 


40.0% 


60.0% 


55 



If you answered YES, please' list one or two specific topics that you would 
like to see added to* the training' workshops. 

"More about fraction^. . .mgfre counseling on dealing with student and parent apathy . 

need more workshops for techniques. . . more time given at workshops to exchang e 
idea's../ 1 

About what percentage of the pupils* you worked with this quarter were not/ 
on the Pupil Eligibility List? (Check one) 

None 

E.A.T. 52.5% 
P.A.T. 60.0% 

Total m 54.6% 



If some of the pupils you worked with were not on the Pupil Eligibility List, 
please explain' why they were tutored anyway. , 

"Because the teacher asked and the child needed it... teacher felt the children 
needed some help in specific ski lip. ..Requested by teachers and principals... 
transferred from anQther /chool and their school records had not arrived yet.. . 

-225- • , 



1-25%- 


26-50% 


51-75% 


, 76,-100% 


N 


35.0% 


5.0% 


2.5% 


5.0% 


40 


33.3% 


0.6% 


• 6.7% 


* 0.0% 


15 


34.6% 


3.6% 


3*. 6% 

r 


3.6%_ .*- 















• , APPENDIX B (Cont'd^ 

10. When you are assigned a pupil for tutoring in reading or math, does y©ur 
supervising teacher clearly identify the specific skill to be tutored by 
• checking one of fhose listed on the pujJil- referral form? (Check one in 
ea^hr column) . , 

r ' • /% 

( When Pupil Needs When, Pupil Needs " 

Vj Reading Tutoring M^tH < Tutoring , 



E.A.T. 


82.5% 




80.0% 


Teacher always identifies specific skill 


P.A.T. 


. 81.2% 




75.0% ' 


■ m 


Total 


82*1% 




28.7% 




E J*Ct. 


15.0% 




15.0% 


Teacher usually identifies sueGific skill 


"P*A.T. 


12.5% 




12.5% 




Total 


14.3% » 




14.3% 




e.a;t. 


2.5% 




1 

5.0% 


Teacher sometimes identifies specific ski 


P.A.T. 


6.3% 




12.5% 


r 

1 


Total 


3.6% 




7.1% 


w » 


E.A.T. 


0.0% 




0.0% 


Teacher seldom identifies specific skill 


P.A.T. 


0.0%, : 




0.0% 




Total 


0.0% 




0.0% 


r 

\ 


** 

How often do you have conferences with 


your supervising teacher to review 


the work done and the progress made by the pupils you tutor? (Check one) 




About oncfe 


Several times About once- About once every two weeks 




a day 


a week 


a 


week , or less frequently N 


E.A.T. 


. 5.1% 


33.3% 


41 


.0% ^0.5% ^ 39 


P.A.T. 


12.5% 


12.5% 


56 


.3% 18.7% ' , 16 


Total 


7.3% 


27.3% 


_45 


.4% 20.0% 4 55 


Has your Project Consultant Teacher demonstrated the use of tutoring* techniques 


with any of your pupils this year? 








Yes 




No N 




E.A.T. 


87.5% 


12.5% 40 ' 




P.A.T. 

i 


93.8% 




6.2% ■ 16 




Total 


89.3% 


10.7% 56 


If you answered YES, 


how helpful to you 


did you find these demonstrations? 




Very- Helpful 


Somewhat Helpful Not Very Helpful * - N 


»E.A.T. 


88.6% 




11.4% 


0.0% ' 35 


R..A.T. 


93(3% " 




^6.7% 


2'?i 0.0% - IS 



Total 90.0% , 10.0% , _ - 0V0% 50- 
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APPENDIX B (Cont'd)- 

v r #» 

How helpfyil to you is the Res i^^C* Tutor Manual as a source of ideas for 
tutoring activities? ^ 



P.A.T. 
Total 



Very Hejpful 
.90.2% ■ 
87.51 
89.5% 



gom-ewhat Helpful 
9.8% 
' 12.5% 
10.5% 



Not Very Helpful 
0.0% 
. 0.0% 
0.0% 



N ' 
41 
16 
57 



14. If you think the Resident Tutor Manual needs to be improved, please list one 
or two specific suggestions for improvement . "I think the content^ of the RTP 

test needs to be completely revised... It could have more activities for master- 
ing multiplication facts... more activities for reading.'.." ^ ' 

15. Could your contacts with your Project Consultant Teacher be made more helpful ^ 
. to you? 





■ Yes 


No 


N 


E.AJ. 


17.9% 


82.1% 


39 


P.A.T. 


\20.0% 


80.0% 


15 


THAI 


18.5% 


81.5% 


54 



. If you answered YES, please list one or two specific ways in which tihe 
Project Consultant Teacher could be mgre helpful. 

i . • 

"...having more visits than usual... The Consultant Teachers are terrific - and 

♦ 

have much to' share with us. 'Brit - we ne ed more workshops with them.,."*; 

16, Hov/many different teachers hdke^bu tutored pupils for this year? 





Average 


* Median. 


Range* 


N * ' , ' 


E.A.T. 


6.2 


\ 5^ 


2-14 


41 ' «■ 


P.A.T. { 


5.6 


5 


3-10 , 


16 


Total 

V 

4 

( 


'6.0 

v • 
J * 

4 


5 

>• 

i 


^ 2-14 


57 . 

0 

1 

I- 










*- 


_ * * / 


\ . 






* 
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APPENDIX C \ 
, RESIDENT TUTOR TEACHER QUESTIONNAIRE SUMMARY 

N = 29 

The Division o£ Research and Development is collecting information 
and opinion from a sample 'of teachers receiving service from the Resident Tutor 
Project, The information you provide will, be tised to try to improve project 
operations . You need not sign this questionnaire . t ^ 

Please use the attached envelope to send your completed questionnaire 
by WEDNESDAY, July *16, to the "address'below. (Use the school mail if you work 
in a public school). ' % 

' Derek B. Taylor- 

Division of Research and Development m * ^ 

Cleveland Public Schoqls 
1380 East 6th Street — 
Cleveland, Ohio 44114 

1. How many children in your class have received Resident Tutqr services this 
year? ' . Avg.: 7,0; Mediant 7; Range: 2-17 < 

2, In all, how many tutors have been assigned to your classroom this year, in- 
jding your present tutor? . Avg.: * 1.2; Median : 1; Range 0-3 U 




3. On average, how many days per week does a pupil work with* a'tutor? Avg.: 4 .8; 

'Median:* 5; Range: 3-5 

4. Check the most important reasons (check no more than two|Jthat you referred 
pupils for tutoring services this year., * % 

— ft 

t7*8% Curriculum-embedded reading test 17.8% Teacher -made test performance 

" performance 

17.ffi /cTBS test "performance . 75 . 0% CI assroom performance ; 

14. 3% Stanford Diagnostic 1 Reading ' 7 . l% ^tropol it an * Reading /Test 

Test performance • T* performance 

* S 

' 39.3% Cleveland Mathematics Test _ 7.1% 0ther (Please specify) 

performance ^ " • 

Math Skills, Tutor was assigned to i6e 

10^7% Mathematics facts test * 

, performance because I had a split class 3 § 4 . 

5. How often are you able to actually observe how your tutor works with the tutees? 

/ About once a day 6.9% , Several times ,a* week ^13. 8 % About once a week. 20*7% 

* 

About once every two weeks or less frequently 44*8% Not at all 13.8% 
-Does this enable you to adequately monitor the tutor's work? Yes 65. 4% No 34>,6' 



A > 
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APPENDIX C (Cont'd) 



6. Would you permit the tutor to work-in your classroom is necessary? 
Yes 82.»% No 17.2% If NO, why not? 

~~ — " < — 1 $: — 

. "Very disruptive to other distractible children. 11 ■ ^ 



7. How often do you have conferences with the tutor to review the work done and 
the progress made by the tutee? 

About once a da y 11*1% Several t^iraes a week 37.0% About once a week 25.9% 

About once every. two weeks or less frequently 25*9% ^ 

8. From your experience this year, what has been the most valuable feature or 
0 effect of ' ttfe. Resident Tutor Project? 

- "The children have made progress in reading and math... The one to, one contac t 

has been excellent. . .GiVes the student ektra help. . .importan t reinforcement. . ." 
: 

9. Are there changes you would like to see in the Resident Tutor project to make '* m 
it more beneficial^A the students ijli sojtflease specify suggestions. 



11 ...more tutors assigned so more children could benefit . ..Tutors should be 



A, 



allowed to work with other students.. 



V 



10. Have you ever withdrawn a child from Resident Tutor services? 

Yes 10.5% No 89.7% If YES, for what reasons? 



> 



* "Improvement of skills... To g£ve other children the much needed service. 11 



11. Has working with a Resident Tutor created any problems for you? (Briefly de- 
scribe any) ♦ \ 

"No major ones... it has been a beautiful and beneficial experience. . .No, 1^ 
» 

wish thdire were more of them-.." 



\ 
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APPENDIX D _ 

, Mean Pre and Post Scores, on Resident Tutor* 
Skill Tests in Reading anc^ Mathematics* 

* 



Subtest 


Ji 

N , 


Pre 


Post 
ooneci 


" Gain - 


v / 






OA 7 


A 1 7 
Oi . / 


Vocabulary 


16 


31.3' '. 


85.0 


53.8 


Aud/Vis Perception 


/6 


46.7 


, 80.0 


33.3 


Long/Shout Vowels 


16 


34.9 


68.4 


35.4 


Syllabication ' 


3 


34.7 


74.0 


39.3 




c 

D 


t 

40 . u 


oo . 0 


40 .0 


Reading Total/Average 


49 


36.3 


. 79.1 


43.4 


Add/Sub Facts 


18 


27.9 


80.8 


53.5 


Mult/Div Facts 


18 


36.2 


80.4 . 


42.7 


Add/Sub Computation 


21 


49.0 


78.6 


. 29.5- 


, Mult/Div Confutation 


16 


38.0 


* 

85.0 


* — 

47.0 


Problem Solving 


2 


35.0 /" 


80.0 


45.0 *' 


Math Total /Average 


75 


38.2 


81.0 


42.6 



/ 



\ 
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APPENDIX E 

i 

Summary of Mean NCE Scores on Subtests of STANFORD Diagnostic Reading Test 



ERIC 



* Grade Level 


Subtest 


N Pre % Po?t Gain 


4 

-4 


\ 

^uditory Vocabulary. 
Auditory Discrimination 
Phonetic Analysis 
Structural Analysis 
Total/ Aver age 


13 33.5 42.5 + 9.0 
1 31.0 35.0 + 4.0 " 

• 1 A 11 A A A A j-IOiC 

10 ' 01.4 44,0 +12.0 
5 - 42«8 53.2 . +10.4 


29 w 34.3/ 44.6 +10.3 


5 


v Auditory Vocabulary 
Phonetic Analysis 
Structural Analysis 
Total/Average 


16 26". 1 48.3 +22.2 

Q i 1A O A 1 n a. 0/1 Q 

10 15.8 19. 0 - + 3.2 


35 20-.6 . 38.1 +17.4 

* t 


*. 

t 


Auditory Vocabulary 
"Phonetic Analysis* 
Structural Analysis 

\ 

Total/Average 


1 -~ 

15 31.1 27.5 t 3.7 
6 33:8 17.7 -16.2 
10 ■ 26°.5 31.0 +* 4.5 


31 30.2 ' 26.7 - 3.6 ' 
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